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Introduction 


Cybertherapy  can  be  considered  the  integration  of  telehealth 
technologies  with  the  Internet  and  shared  virtual  reality. 
Although  cybertherapy  is  a  branch  of  telehealth,  it  is 
differentiated  in  several  important  ways:  telehealth  to  date  has 
been  largely  non- Internet  based  and  has  been  characterized  by 
point-to-point  (e.g.,  Tl)  and  dial-up  (e.g.,  telephone,  ISDN) 
information  exchange. 

Cybertherapy,  on  the  other  hand,  is  more  accessible  due  to  the 
integrated  use  of  shared  media.  Using  the  Internet  and  virtual 
reality  tools  the  therapists  may  present,  from  a  remote  site,  a 
wide  variety  of  stimuli  and  to  measure  and  monitor  a  wide 
variety  of  responses  made  by  the  user. 

In  general,  there  are  two  reasons  why  cybertherapy  is  used: 
either  because  there  is  no  alternative,  or  because  it  is  in  some 
sense  better  than  traditional  medicine.  Up  to  now  the  benefits 
of  cybertherapy  -  due  to  the  variety  of  its  applications  and 
their  uneven  development  -  are  not  always  self-evident. 

However,  the  Cybertherapy  2004  conference  wants  to  show  that  the 
emergence  of  cybertherapy  trials  is  supporting  the  cost- 
effectiveness  of  certain  applications,  such  as  neuroscience, 
rehabilitation  and  clinical  psychology.  Its  key  advantage  is  the 
possibility  of  sharing  different  media  and  different  health  care 
tools  in  a  simple  to  use  and  easily  accessible  interface. 

Particular  attention  will  be  given  to  the  clinical  use  of 
virtual  reality  technology.  An  important  part  of  this  overview 
are  the  clinical  results  coming  from  the  European  Union  VEPSY 
Updated  -  Telemedicine  and  Portable  Virtual  Environments  for 
Clinical  Psychology  -  research  project  (IST-2000-25323 
http: / /www. cybertherapy . info)  .  More  in  detail,  the  conference 
presentations  will  show  that  different  cybertherapy  applications 
have  improved  the  quality  of  health  care,  and  later  they  will 
probably  lead  to  substantial  cost  savings. 

However,  cybertherapy  is  not  simply  a  technology  but  a  complex 
technological  and  relational  process.  In  this  sense,  clinicians 
and  health  care  providers  that  want  to  successfully  exploit 
these  tools  need  a  significant  attention  to  clinical  issues, 
technology,  ergonomics,  human  factors  and  organizational  changes 
in  the  structure  of  the  relevant  health  service. 
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To  spread  the  diffusion  of  cybertherapy,  further  research  is 
needed.  More  evaluation  is  required  of  clinical  outcomes, 
organizational  effects,  benefits  to  health-care  providers  and 
users,  and  quality  assurance.  It  is  also  very  important  that 
professionals  in  this  field  share  information  about  their 
experience  and  examine  the  results  of  evaluations  so  that  the 
suitable  development  work  can  be  speeded  up. 

In  conclusion,  the  goal  of  this  conference  is  to  analyze  and 
discuss  the  processes  by  which  cybertherapy  applications  can 
contribute  to  the  delivery  of  state-of-the-art  health  services. 
We  expect  that  the  contents  of  this  conference  will  stimulate 
more  clinicians  and  technical  professionals  in  finding  new 
solutions  in  order  to  expand  their  intervention  interests  and  in 
making  better  use  of  the  innovative  cybertherapy  tools. 

Body 

These  proceedings  consist  of  selected  papers  from  the  Ninth 
Annual  CyberTherapy  Conference:  Interactive  Media  in  Training 
and  Therapeutic  Interventions.  The  CyberTherapy  Conference 
evolved  from  the  Advanced  Technologies  in  Mental 
Health/Rehabilitation  Symposium  that  was  held  as  part  of  the 
Medicine  Meets  Virtual  Reality  (MMVR)  Conference  for  seven 
years .  Because  of  the  growth  experienced  by  the  Advanced 
Technologies  in  Mental  Health/Rehabilitation  Symposium,  it  was 
decided  that  the  symposium  should  be  expanded  into  its  own 
separate  conference  organized  by  the  Interactive  Media 
Institute,  a  nonprofit  corporation  that  helps  educate  the  public 
and  disseminate  information  on  the  uses  of  advanced  technologies 
in  the  fields  of  mental  health,  rehabilitation,  and 
disabilities.  The  conference  was  held  on  January  10-12,  2004  in 
San  Diego,  California  and  was  attended  by  distinguished 
researchers  and  clinicians  from  thirteen  different  countries. 

This  year's  response  to  the  conference's  call  for  papers  was 
incredible,  causing  organizers  to  add  a  day  of  workshops  prior 
to  the  conference.  The  research  was  of  superior  quality,  and  the 
topics  presented  spanned  numerous  areas  in  the  virtual  reality 
and  mental  health  fields.  The  array  of  expertise  fostered  an 
environment  conducive  to  active  discussion  and  debate  between 
scientists,  leading  to  a  wonderful  distribution  and  sharing  of 
ideas . 

In  the  first  paper,  Viaud-Delmon,  Seguelas,  &  Rio,  et  al . 
discuss  the  importance  of  auditory  feedback  in  VR  systems  for 
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clinical  use.  Two  virtual  environments,  visual  alone  and 
auditory-visual ,  compared  normal  subjects  and  agoraphobic 
patients.  Normal  subjects  reported  a  better  sense  of  presence 
and  realism  in  the  auditory-visual  environment.  However, 
agoraphobic  patients  experienced  more  cybersickness  in  this 
condition,  possibly  due  to  a  multisensory  integration  deficit  of 
anxious  patients.  This  reveals  one  of  many  factors  that  need  to 
be  taken  into  account  when  building  a  bimodal  virtual 
environment . 

The  second  paper,  written  by  Viciana-Abad,  Reyes -Lecuona,  & 
Garcia-Berdones,  et  al .  ,  focuses  on  the  relationship  between 
significant  information,  presence,  and  stress  in  virtual 
environments.  The  results  of  the  study  suggest  a  strong,  close 
relationship  between  increments  of  stress  and  presence,  and  that 
each  element  could  be  cause  and  consequence  of  the  other. 

Next,  Rand,  Kizony,  &  Brown,  et  al .  comment  on  the  differences 
in  sense  of  presence,  performance  and  perceived  exertion.  Users 
engaged  in  two  games  within  virtual  environments  that  differed 
in  their  level  of  structure  and  spontaneity.  It  was  found  that 
both  structured  and  non- structured  environments  can  be  a  helpful 
intervention  tool  in  rehabilitation,  though  one  may  be 
preferable  over  the  other  depending  on  the  patient's  gender,  the 
therapeutic  objectives,  and  other  factors. 

The  fourth  paper,  by  Riva,  Alcaniz,  &  Anolli,  et  al .  ,  is  an 
update  on  the  status  of  the  VEPSY  Project.  The  goal  of  the 
project  is  to  develop  different  PC-based  virtual  reality  modules 
to  be  used  in  clinical  assessment  and  treatment  of  social 
phobia,  panic  disorders,  male  sexual  disorders,  obesity,  and 
eating  disorders.  The  current  head-mounted  display  (HMD),  two- 
button  joystick,  and  software  technologies  are  presented,  as 
well  as  the  success  of  VR  when  integrated  with  traditional 
psychotherapy  approaches . 

The  next  article  is  written  by  Gaggioli,  di  Carlo,  &  Mantovani, 
et  al .  of  the  Istituto  Auxologico  Italiano  in  Milan,  Italy.  It 
outlines  the  history  and  current  state  of  telemedicine  in  Italy, 
focusing  on  physicians'  attitudes.  The  article  encourages 
increased  circulation  of  information  on  new  technologies  and  a 
focus  on  the  benefits  for  the  patient,  with  the  goal  of  allowing 
telehealthcare  to  grow  in  popularity. 

The  following  paper,  by  Csukly,  Simon,  Kiss,  and  Takacs, 
describes  a  psychiatric  assessment  tool  that  animates  3D  faces 
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of  virtual  humans  in  real-time  to  evoke  and  measure  emotional 
responses  of  psychiatric  patients.  The  patients'  ability  to 
recognize  basic  expressions  (such  as  neutral,  happiness, 
surprise,  fear,  anger,  disgust,  or  sadness)  of  the 
photorealistic  models  is  used  as  an  indication  of  their  mental 
health,  and  mapped  onto  scientifically  evaluated  symptoms  of  the 
respective  brain  disorders.  Early  clinical  results  demonstrate 
that  the  new  assessment  tool  can  be  effectively  used  to  screen 
patients  for  a  group  of  well-defined  psychiatric  disorders. 

Klinger,  Chemin,  Lebreton,  and  Marie's  article  reports  on  a 
virtual  supermarket  in  which  patients  with  Parkinson's  disease 
and  control  subjects  were  tested  on  precision  and  efficiency  in 
a  real-world  situation.  There  was  no  significant  difference 
between  patients  and  control  subjects  for  the  number  of  correct 
actions,  which  suggests  that  global  access  to  the  semantic 
knowledge  of  the  script  is  normal  in  Parkinson's  patients. 
However,  more  specific  measures  such  as  distance,  duration, 
number  of  stops,  and  recorded  trajectory  allow  for  precision  in 
identifying  the  planning  alteration  in  Parkinson's.  Continued  VR 
techniques  are  expected  to  allow  significant  progress  in  the 
prediction  of  action  planning  in  everyday  life,  as  well  as 
assist  in  rehabilitation  relevant  to  patients'  real  worlds. 

Another  issue  for  aging  patients  is  joint  disease,  as  Kline- 
Schoder,  Kane,  &  Fishbein,  et  al .  have  focused  on.  Physical 
therapy  is  an  effective  treatment,  though  the  accompanying  pain 
discourages  many  patients.  Kline-Schoder  &  colleagues  have 
proven  here  that  using  VR  to  distract  patients  from  pain  during 
treatment  and  physical  therapy  is  effective,  and  enjoyed  by  the 
patients . 

Lockerd,  Brisben,  and  Lathan  are  working  with  child 
rehabilitation  using  their  system  CosmoBot™,  an  interactive 
Robot  toy,  and  Mission  Control,  an  adaptive  control  interface 
which  allows  users  to  control  CosmoBot™  using  gesture  and  voice. 
These  systems  have  been  used  with  children  undergoing  various 
types  of  rehabilitation  therapies,  including  physical, 
occupational,  and  speech/language  therapy.  The  system  was 
determined  to  be  a  useful  motivational  tool,  targeting  a  number 
of  therapeutic  and  educational  goals. 

Inspired  by  the  positive  effects  of  animal/human  interaction  on 
humans,  Shibata,  Wada,  Saito,  and  Tanie  have  developed  an 
interactive  robot  for  therapeutic  purposes  in  the  form  of  a 
realistic  baby  seal.  "Paro"  was  presented  in  a  health  care 
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facility  for  the  elderly  for  three  weeks,  and  in  response 
subjects'  moods  improved  as  measured  by  face  scales,  the  Profile 
of  Mood  States  questionnaire,  and  comments  from  the  nursing 
staff.  This  was  compared  with  a  "placebo  Paro"  which  merely 
repeated  a  string  of  actions  and  sounds  rather  than  reacting  to 
subjects'  behavior.  Surprisingly,  both  robots  were  effective  in 
improving  mood  and  alleviating  depression,  perhaps  because  the 
subjects  did  not  notice  the  difference  or  were  not  interested  in 
the  mechanisms  behind  Paro's  performance. 

Next,  Stef fin  and  Wahl  address  the  problem  of  air  and  automotive 
accidents  caused  by  drowsiness.  They  offer  a  real-time  on-road 
alertness  monitor  consisting  of  two  laterally  mounted  cameras 
outside  the  driver's  field  of  view.  The  output  from  the  cameras 
is  processed  to  measure  the  frequency  and  duration 
characteristics  of  the  driver's  head  position  in  relation  to  a 
standard  driving  position  correlated  behaviorally  with 

alertness.  Eye  and  mouth  positions  and  motions  are  also  analyzed 
and  checked  for  patterns  of  eye  opening  and  closing  and  yawning. 

Mager,  Stoermer,  &  Estoppey,  et  al .  research  the  effects  of 
sleep  deprivation  on  41  professional  and  "normal"  drivers  using 
a  real -car  based  static  augmented  reality  driving  simulator.  The 
simulator  measured  the  performance  state,  and  subjects' 

vigilance  was  measured  using  electroencephalography  (EEG) .  When 
drowsiness  was  detected,  a  warning  was  given  by  the  Driver 

Warning  System,  and  subjects'  levels  of  vigilance  returned  in 
response . 

St.  Germain,  Kurtz,  Pearl son,  and  Astur  created  a  desktop 
driving  simulator  to  test  driving  skills  and  see  how  an 
individual  would  respond  to  everyday  driving  hazards  (e.g. 

children  running  in  front  of  the  car,  cars  running  red  lights, 
car  running  a  stop  sign,  etc.).  The  hypothesis  was  that  people 
diagnosed  with  schizophrenia  would,  as  a  group,  display  driving 
impairments.  Schizophrenic  subjects  did  in  fact  make  more  errors 
in  crossing  white  and  yellow  lines,  and  showed  a  trend  towards 
more  collisions  despite  driving  significantly  slower  than 
control  subjects.  This  suggests  that  patients'  real-life  driving 
may  be  impaired  as  well. 

In  the  next  paper,  Tarnanas  and  Manos  deal  with  the  development 
and  evaluation  of  two  different  virtual  reality  cognitive- 
behavioral  treatment  settings  and  compare  their  effectiveness  in 
disaster  preparedness  and  acute  stress  response  (ASR) .  The  two 
basic  modes  of  interaction  are  a  guided  "storytelling"  mode  and 
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an  interactive  mode  where  the  participant  controls  his  or  her 
navigation/actions  in  a  simulated  earthquake.  Children  who  had 
and  had  not  previously  experienced  medium- si zed  earthquakes 
comprised  the  subject  groups.  The  interactive  mode  was  found  to 
be  particularly  helpful  when  familiar  faces  were  included  in  the 
simulation,  as  the  child's  level  of  fear  was  affected  by  other 
students'  levels  of  fear. 

After  that,  Hayes-Roth,  Amano,  Saker  and  Sephton  discuss  their 
system,  STAR™  Workshop,  which  is  intended  to  help  clinicians 
gain  training  in  brief  intervention  techniques  for  patients  with 
alcohol  or  substance  abuse  problems.  STAR™  is  an  online  training 
workshop  incorporating  a  virtual  coach  and  virtual  standardized 
patients.  The  coach  motivates  and  teaches  an  evidence-based 
brief  intervention  protocol,  and  virtual  patients  provide 
practice  and  intrinsic  reinforcement.  After  each  practice 
session,  the  coach  offers  additional  feedback  and  any  needed 
remediation.  The  STAR  workshop  was  evaluated  in  comparison  to  a 
self-paced  E-book  containing  the  same  content  and  a  control 
group  with  no  training.  Subjects  trained  with  STAR  Workshop 
substantially  outperformed  subjects  in  the  other  conditions, 
indicating  that  this  system  may  be  an  effective  and  affordable 
method  for  training  brief  intervention  skill  in  alcohol  abuse. 

Ng  and  Wiemer-Hastings  explore  internet  addiction  and  conduct  a 
survey  comparing  players  of  offline  video  games  and  players  of 
Massively  Multiplayer  Online  Role-Playing  Games  (MMORPGs) .  Those 
who  play  MMORPGs  spent  significantly  more  time  in-game,  and 
stated  that  they  are  happiest  in-game  and  would  choose  it  over 
interaction  with  real  life  friends.  However,  it  was  found  that 
it  is  the  social  aspects  that  exist  in-game  that  draw  users  into 
MMORPG's.  Even  with  high  usage  times,  MMORPG  users  cannot  be 
categorized  as  addicted,  because  they  do  not  exhibit  the 
behaviors  of  addicts. 

Key  Research  Accomplishments 

The  CyberTherapy  2004  meeting  brought  together  the  world's  leaders 
in  clinical  application  of  virtual  reality.  This  conference 
resulted  in  the  publication  of  numerous  scientific  papers,  which 
are  reproduced  in  the  proceedings . 

Reportable  Outcomes 

The  outcomes  of  this  conference  resulted  in  significant 
dissemination  of  scientific  information.  In  addition,  the  success 
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of  this  conference  has  resulted  in  the  next  conference, 
CyberTherapy  2005,  which  is  being  held  in  Basel  Switzerland. 

Conclusions 

The  scientific  results  of  this  conference  are  published  in  the 
Proceedings  of  The  9th  Annual  CyberTherapy  Conference . 
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(From  the  Organizers 

Welcome  to  the  9th  Annual  CyberTherapy  Conference.  This  conference  was  originally  held  as 
part  of  the  Medicine  Meets  Virtual  Reality  Conference,  beginning  in  1996  with  a  half-day  sympo¬ 
sium,  and  a  few  presentations  mostly  concerning  conceptual  matters  and  future  possibilities.  I 
am  happy  to  report  that  after  9  years,  we  have  progressed  to  a  three-day  conference,  accompa¬ 
nied  by  a  full  day  of  pre-conference  workshops  on  specialty  topics.  This  conference  encom¬ 
passes  the  largest  collection  of  clinical  trials  for  advanced  technologies  in  mental  health,  reha¬ 
bilitation,  and  disabilities.  The  quality  and  significance  of  the  excellent  work  being  presented  at 
this  conference  reaffirms  the  fact  that  virtual  reality  can  play  a  significant  role  in  improving 
healthcare.  In  addition,  we  have  achieved  significant  milestones  by  attracting  financial  support 
from  a  wide  variety  of  funding  agencies.  It  is  our  specific  intention  to  bring  together  the  best  cli¬ 
nicians  and  researchers  with  representatives  from  funding  agencies  that  are  interested  in  apply¬ 
ing  advanced  technologies  to  improve  healthcare.  In  this  way,  we  may  further  strengthen  and 
advance  the  efforts  to  enrich  healthcare,  improve  the  quality  of  life  of  our  patients,  and  benefit 
from  the  remarkable  technological  revolution  that  is  occurring. 

This  year  we  note  that  over  half  of  the  presenters  are  new  and  have  not  attended  any  of  the  pre¬ 
vious  conferences.  This  trend  confirms  that  the  use  of  virtual  reality,  simulation,  and  other  ad¬ 
vanced  technologies  continues  to  attract  new  researchers  from  around  the  globe  who  bring  ex¬ 
citing  new  ideas  and  applications  to  further  this  area  of  investigation. 

I  look  forward  to  the  opportunity  to  meet  friends  and  colleagues  from  past  conferences  as  well 
as  greeting  our  new  attendees  and  guests.  We  have  already  begun  planning  for  CyberTherapy 
2005,  where  we  will  continue  to  engage  the  international  interest  of  clinicians,  researchers,  and 
representatives  from  a  variety  of  governmental  and  private  funding  agencies.  We  hope  you  find 
this  year’s  conference  a  rewarding  and  intellectually  stimulating  experience.  We  look  forward  to 
seeing  you  again  next  year  at  the  1 0th  annual  CyberTherapy  Conference  to  be  held  the  1 st  week 
in  June  2005  in  Switzerland. 


Sincerely, 

Brenda  K.  Wiederhold,  Ph.D.,  MBA,  BCIA 
2004  Program  Chair 
Interactive  Media  Institute 
The  Virtual  Reality  Medical  Center 


9 


From  the  Organizers 

Cybertherapy  can  be  considered  the  integration  of  telehealth  technologies  with  the  Internet  and 
shared  virtual  reality.  Although  cybertherapy  is  a  branch  of  telehealth,  it  is  differentiated  in  sev¬ 
eral  important  ways:  telehealth  to  date  has  been  largely  non-Internet  based  and  has  been  char¬ 
acterized  by  point-to-point  (e.g.,  T1)  and  dial-up  (e.g.,  telephone,  ISDN)  information  exchange. 

Cybertherapy,  on  the  other  hand,  is  more  accessible  due  to  the  integrated  use  of  shared  media. 
Using  the  Internet  and  virtual  reality  tools  the  therapists  may  present,  from  a  remote  site,  a  wide 
variety  of  stimuli  and  to  measure  and  monitor  a  wide  variety  of  responses  made  by  the  user. 

In  general,  there  are  two  reasons  why  cybertherapy  is  used:  either  because  there  is  no  alterna¬ 
tive,  or  because  it  is  in  some  sense  better  than  traditional  medicine.  Up  to  now  the  benefits  of 
cybertherapy  -  due  to  the  variety  of  its  applications  and  their  uneven  development  -  are  not  al¬ 
ways  self-evident. 

However,  the  Cybertherapy  2004  conference  wants  to  show  that  the  emergence  of  cybertherapy 
trials  is  supporting  the  cost-effectiveness  of  certain  applications,  such  as  neuroscience,  rehabili¬ 
tation  and  clinical  psychology.  Its  key  advantage  is  the  possibility  of  sharing  different  media  and 
different  health  care  tools  in  a  simple  to  use  and  easily  accessible  interface. 

Particular  attention  will  be  given  to  the  clinical  use  of  virtual  reality  technology.  An  important  part 
of  this  overview  are  the  clinical  results  coming  from  the  European  Union  VEPSY  Updated  - 
Telemedicine  and  Portable  Virtual  Environments  for  Clinical  Psychology  -  research  project  (IST- 
2000-25323  -  http://www.cvbertherapy.info l  More  in  detail,  the  conference  presentations  will 
show  that  different  cybertherapy  applications  have  improved  the  quality  of  health  care,  and  later 
they  will  probably  lead  to  substantial  cost  savings. 

However,  cybertherapy  is  not  simply  a  technology  but  a  complex  technological  and  relational 
process.  In  this  sense,  clinicians  and  health  care  providers  that  want  to  successfully  exploit 
these  tools  need  a  significant  attention  to  clinical  issues,  technology,  ergonomics,  human  factors 
and  organizational  changes  in  the  structure  of  the  relevant  health  service. 

To  spread  the  diffusion  of  cybertherapy,  further  research  is  needed.  More  evaluation  is  required 
of  clinical  outcomes,  organizational  effects,  benefits  to  health-care  providers  and  users,  and 
quality  assurance.  It  is  also  very  important  that  professionals  in  this  field  share  information  about 
their  experience  and  examine  the  results  of  evaluations  so  that  the  suitable  development  work 
can  be  speeded  up. 

In  conclusion,  the  goal  of  this  conference  is  to  analyze  and  discuss  the  processes  by  which  cy¬ 
bertherapy  applications  can  contribute  to  the  delivery  of  state-of-the-art  health  services.  We  ex¬ 
pect  that  the  contents  of  this  conference  will  stimulate  more  clinicians  and  tech-nical  profession¬ 
als  in  finding  new  solutions  in  order  to  expand  their  intervention  interests  and  in  making  better 
use  of  the  innovative  cybertherapy  tools. 


Giuseppe  Riva,  Ph.D.,  M.S,  M.A.,  Chart.  Psych. 
2004  Conference  Chair 

Applied  Technology  for  Neuro-Psychology  Lab. 
Istituto  Auxologico  Italiano 


10 


Proceedings  Overview 


Brenda  K.  Wiederhold,  Ph.D.,  BCIA 

Virtual  Reality  Medical  Center,  San  Diego,  CA 
Interactive  Media  Institute,  San  Diego,  CA 


These  proceedings  consist  of  selected  papers 
from  the  Ninth  Annual  CyberTherapy  Confer¬ 
ence:  Interactive  Media  in  Training  and  Thera¬ 
peutic  Interventions.  The  CyberTherapy  Confer¬ 
ence  evolved  from  the  Advanced  Technologies 
in  Mental  Health/Rehabilitation  Symposium  that 
was  held  as  part  of  the  Medicine  Meets  Virtual 
Reality  (MMVR)  Conference  for  seven  years. 
Because  of  the  growth  experienced  by  the  Ad¬ 
vanced  Technologies  in  Mental 
Health/Rehabilitation  Symposium,  it  was  de¬ 
cided  that  the  symposium  should  be  expanded 
into  its  own  separate  conference  organized  by 
the  Interactive  Media  Institute,  a  nonprofit  cor¬ 
poration  that  helps  educate  the  public  and  dis¬ 
seminate  information  on  the  uses  of  advanced 
technologies  in  the  fields  of  mental  health,  reha¬ 
bilitation,  and  disabilities.  The  conference  was 
held  on  January  10-12,  2004  in  San  Diego,  Cali¬ 
fornia  and  was  attended  by  distinguished  re¬ 
searchers  and  clinicians  from  thirteen  different 
countries. 

This  year’s  response  to  the  conference’s  call  for 
papers  was  incredible,  causing  organizers  to 
add  a  day  of  workshops  prior  to  the  conference. 
The  research  was  of  superior  quality,  and  the 
topics  presented  spanned  numerous  areas  in 
the  virtual  reality  and  mental  health  fields.  The 
array  of  expertise  fostered  an  environment  con¬ 
ducive  to  active  discussion  and  debate  between 
scientists,  leading  to  a  wonderful  distribution 
and  sharing  of  ideas. 

In  the  first  paper,  Viaud-Delmon,  Seguelas,  & 
Rio,  et  al.  discuss  the  importance  of  auditory 
feedback  in  VR  systems  for  clinical  use.  Two 
virtual  environments,  visual  alone  and  auditory- 
visual,  compared  normal  subjects  and  agora¬ 
phobic  patients.  Normal  subjects  reported  a 
better  sense  of  presence  and  realism  in  the 
auditory-visual  environment.  However,  agora¬ 
phobic  patients  experienced  more  cybersick¬ 
ness  in  this  condition,  possibly  due  to  a  mul- 
tisensory  integration  deficit  of  anxious  patients. 


This  reveals  one  of  many  factors  that  need  to 
be  taken  into  account  when  building  a  bimodal 
virtual  environment. 

The  second  paper,  written  by  Viciana-Abad, 
Reyes-Lecuona,  &  Garcia-Berdones,  et  al.,  fo¬ 
cuses  on  the  relationship  between  significant 
information,  presence,  and  stress  in  virtual  envi¬ 
ronments.  The  results  of  the  study  suggest  a 
strong,  close  relationship  between  increments 
of  stress  and  presence,  and  that  each  element 
could  be  cause  and  consequence  of  the  other. 

Next,  Rand,  Kizony,  &  Brown,  et  al.  comment 
on  the  differences  in  sense  of  presence,  per¬ 
formance  and  perceived  exertion.  Users  en¬ 
gaged  in  two  games  within  virtual  environments 
that  differed  in  their  level  of  structure  and  spon¬ 
taneity.  It  was  found  that  both  structured  and 
non-structured  environments  can  be  a  helpful 
intervention  tool  in  rehabilitation,  though  one 
may  be  preferable  over  the  other  depending  on 
the  patient’s  gender,  the  therapeutic  objectives, 
and  other  factors. 

The  fourth  paper,  by  Riva,  Alcaniz,  &  Anolli,  et 
al.,  is  an  update  on  the  status  of  the  VEPSY 
Project.  The  goal  of  the  project  is  to  develop 
different  PC-based  virtual  reality  modules  to  be 
used  in  clinical  assessment  and  treatment  of 
social  phobia,  panic  disorders,  male  sexual  dis¬ 
orders,  obesity,  and  eating  disorders.  The  cur¬ 
rent  head-mounted  display  (HMD),  two-button 
joystick,  and  software  technologies  are  pre¬ 
sented,  as  well  as  the  success  of  VR  when  inte¬ 
grated  with  traditional  psychotherapy  ap¬ 
proaches. 

The  next  article  is  written  by  Gaggioli,  di  Carlo, 
&  Mantovani,  et  al.  of  the  Istituto  Auxologico 
Italiano  in  Milan,  Italy.  It  outlines  the  history  and 
current  state  of  telemedicine  in  Italy,  focusing 
on  physicians'  attitudes.  The  article  encourages 
increased  circulation  of  information  on  new 
technologies  and  a  focus  on  the  benefits  for  the 
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patient,  with  the  goal  of  allowing  telehealthcare 
to  grow  in  popularity. 

The  following  paper,  by  Csukly,  Simon,  Kiss, 
and  Takacs,  describes  a  psychiatric  assess¬ 
ment  tool  that  animates  3D  faces  of  virtual  hu¬ 
mans  in  real-time  to  evoke  and  measure  emo¬ 
tional  responses  of  psychiatric  patients.  The 
patients’  ability  to  recognize  basic  expressions 
(such  as  neutral,  happiness,  surprise,  fear,  an¬ 
ger,  disgust,  or  sadness)  of  the  photorealistic 
models  is  used  as  an  indication  of  their  mental 
health,  and  mapped  onto  scientifically  evaluated 
symptoms  of  the  respective  brain  disorders. 
Early  clinical  results  demonstrate  that  the  new 
assessment  tool  can  be  effectively  used  to 
screen  patients  for  a  group  of  well-defined  psy¬ 
chiatric  disorders. 

Klinger,  Chemin,  Lebreton,  and  Marie’s  article 
reports  on  a  virtual  supermarket  in  which  pa¬ 
tients  with  Parkinson’s  disease  and  control  sub¬ 
jects  were  tested  on  precision  and  efficiency  in 
a  real-world  situation.  There  was  no  significant 
difference  between  patients  and  control  sub¬ 
jects  for  the  number  of  correct  actions,  which 
suggests  that  global  access  to  the  semantic 
knowledge  of  the  script  is  normal  in  Parkinson’s 
patients.  However,  more  specific  measures 
such  as  distance,  duration,  number  of  stops, 
and  recorded  trajectory  allow  for  precision  in 
identifying  the  planning  alteration  in  Parkin¬ 
son’s.  Continued  VR  techniques  are  expected 
to  allow  significant  progress  in  the  prediction  of 
action  planning  in  everyday  life,  as  well  as  as¬ 
sist  in  rehabilitation  relevant  to  patients’  real 
worlds. 

Another  issue  for  aging  patients  is  joint  disease, 
as  Kline-Schoder,  Kane,  &  Fishbein,  et  al.  have 
focused  on.  Physical  therapy  is  an  effective 
treatment,  though  the  accompanying  pain  dis¬ 
courages  many  patients.  Kline-Schoder  &  col¬ 
leagues  have  proven  here  that  using  VR  to  dis¬ 
tract  patients  from  pain  during  treatment  and 
physical  therapy  is  effective,  and  enjoyed  by  the 
patients. 

Lockerd,  Brisben,  and  Lathan  are  working  with 
child  rehabilitation  using  their  system  Cos- 
moBot™,  an  interactive  Robot  toy,  and  Mission 
Control,  an  adaptive  control  interface  which  al¬ 
lows  users  to  control  CosmoBot™  using  gesture 
and  voice.  These  systems  have  been  used  with 


children  undergoing  various  types  of  rehabilita¬ 
tion  therapies,  including  physical,  occupational, 
and  speech/language  therapy.  The  system  was 
determined  to  be  a  useful  motivational  tool,  tar¬ 
geting  a  number  of  therapeutic  and  educational 
goals. 

Inspired  by  the  positive  effects  of  animal/human 
interaction  on  humans,  Shibata,  Wada,  Saito, 
and  Tanie  have  developed  an  interactive  robot 
for  therapeutic  purposes  in  the  form  of  a  realis¬ 
tic  baby  seal.  “Paro”  was  presented  in  a  health 
care  facility  for  the  elderly  for  three  weeks,  and 
in  response  subjects’  moods  improved  as 
measured  by  face  scales,  the  Profile  of  Mood 
States  questionnaire,  and  comments  from  the 
nursing  staff.  This  was  compared  with  a 
“placebo  Paro”  which  merely  repeated  a  string 
of  actions  and  sounds  rather  than  reacting  to 
subjects’  behavior.  Surprisingly,  both  robots 
were  effective  in  improving  mood  and  alleviating 
depression,  perhaps  because  the  subjects  did 
not  notice  the  difference  or  were  not  interested 
in  the  mechanisms  behind  Para’s  performance. 

Next,  Steffin  and  Wahl  address  the  problem  of 
air  and  automotive  accidents  caused  by  drowsi¬ 
ness.  They  offer  a  real-time  on-road  alertness 
monitor  consisting  of  two  laterally  mounted 
cameras  outside  the  driver’s  field  of  view.  The 
output  from  the  cameras  is  processed  to  meas¬ 
ure  the  frequency  and  duration  characteristics 
of  the  driver’s  head  position  in  relation  to  a  stan¬ 
dard  driving  position  correlated  behaviorally  with 
alertness.  Eye  and  mouth  positions  and  motions 
are  also  analyzed  and  checked  for  patterns  of 
eye  opening  and  closing  and  yawning. 

Mager,  Stoermer,  &  Estoppey,  et  al.  research 
the  effects  of  sleep  deprivation  on  41  profes¬ 
sional  and  “normal”  drivers  using  a  real-car 
based  static  augmented  reality  driving  simula¬ 
tor.  The  simulator  measured  the  performance 
state,  and  subjects’  vigilance  was  measured 
using  electroencephalography  (EEG).  When 
drowsiness  was  detected,  a  warning  was  given 
by  the  Driver  Warning  System,  and  subjects’ 
levels  of  vigilance  returned  in  response. 

St.  Germain,  Kurtz,  Pearlson,  and  Astur  created 
a  desktop  driving  simulator  to  test  driving  skills 
and  see  how  an  individual  would  respond  to 
everyday  driving  hazards  (e.g.  children  running 
in  front  of  the  car,  cars  running  red  lights,  car 
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running  a  stop  sign,  etc.).  The  hypothesis  was 
that  people  diagnosed  with  schizophrenia 
would,  as  a  group,  display  driving  impairments. 
Schizophrenic  subjects  did  in  fact  make  more 
errors  in  crossing  white  and  yellow  lines,  and 
showed  a  trend  towards  more  collisions  despite 
driving  significantly  slower  than  control  subjects. 
This  suggests  that  patients’  real-life  driving  may 
be  impaired  as  well. 

In  the  next  paper,  Tarnanas  and  Manos  deal 
with  the  development  and  evaluation  of  two  dif¬ 
ferent  virtual  reality  cognitive-behavioral  treat¬ 
ment  settings  and  compare  their  effectiveness 
in  disaster  preparedness  and  acute  stress  re¬ 
sponse  (ASR).  The  two  basic  modes  of  interac¬ 
tion  are  a  guided  “storytelling”  mode  and  an  in¬ 
teractive  mode  where  the  participant  controls 
his  or  her  navigation/actions  in  a  simulated 
earthquake.  Children  who  had  and  had  not  pre¬ 
viously  experienced  medium-sized  earthquakes 
comprised  the  subject  groups.  The  interactive 
mode  was  found  to  be  particularly  helpful  when 
familiar  faces  were  included  in  the  simulation, 
as  the  child’s  level  of  fear  was  affected  by  other 
students’  levels  of  fear. 

After  that,  Hayes-Roth,  Amano,  Saker  and 
Sephton  discuss  their  system,  STAR™  Work¬ 
shop,  which  is  intended  to  help  clinicians  gain 
training  in  brief  intervention  techniques  for  pa¬ 
tients  with  alcohol  or  substance  abuse  prob¬ 
lems.  STAR™  is  an  online  training  workshop 
incorporating  a  virtual  coach  and  virtual  stan¬ 
dardized  patients.  The  coach  motivates  and 
teaches  an  evidence-based  brief  intervention 
protocol,  and  virtual  patients  provide  practice 
and  intrinsic  reinforcement.  After  each  practice 
session,  the  coach  offers  additional  feedback 
and  any  needed  remediation.  The  STAR  work¬ 
shop  was  evaluated  in  comparison  to  a  self- 
paced  E-book  containing  the  same  content  and 
a  control  group  with  no  training.  Subjects 
trained  with  STAR  Workshop  substantially  out¬ 
performed  subjects  in  the  other  conditions,  indi¬ 
cating  that  this  system  may  be  an  effective  and 
affordable  method  for  training  brief  intervention 
skill  in  alcohol  abuse. 

Ng  and  Wiemer-Hastings  explore  internet  addic¬ 
tion  and  conduct  a  survey  comparing  players  of 
offline  video  games  and  players  of  Massively 
Multiplayer  Online  Role-Playing  Games 
(MMORPGs).  Those  who  play  MMORPGs 


spent  significantly  more  time  in-game,  and 
stated  that  they  are  happiest  in-game  and  would 
choose  it  over  interaction  with  real  life  friends. 
However,  it  was  found  that  it  is  the  social  as¬ 
pects  that  exist  in-game  that  draw  users  into 
MMORPG’s.  Even  with  high  usage  times, 
MMORPG  users  cannot  be  categorized  as  ad¬ 
dicted,  because  they  do  not  exhibit  the  behav¬ 
iors  of  addicts. 

For  more  information  about  the  CyberTherapy 
2004  conference,  please  visit 
www.vrphobia.com/imi.  My  sincere  thanks  to  all 
of  those  who  participated  and  helped  to  organ¬ 
ize  this  year’s  meeting. 


Brenda  K,  Wiederhold  Ph.D.,  MBA,  BCIA 
Chief  Executive  Officer 
Interactive  Media  Institute 
Executive  Director 
The  Virtual  Reality  Medical  Center 
6160  Cornerstone  Court  East,  Suite  155 
San  Diego,  CA  92121 
bwiederhold@vrphobia.com 
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Abstract:  The  aim  of  this  study  was  to  provide  information  about  the  importance  of  auditory  feed¬ 
back  in  a  VR  system  planned  for  clinical  use,  and  to  address  the  different  factors  that  should  be  ta¬ 
ken  into  account  in  building  a  bimodal  virtual  environment.  We  conducted  an  experiment  in  which  we 
assessed  spatial  performances  in  agoraphobic  patients  and  normal  subjects,  comparing  two  kinds  of 
virtual  environments:  visual  alone  (Vis)  and  auditory-visual  (A  Vis),  during  separate  sessions. 

Subjects  were  equipped  with  a  head-mounted  display  coupled  with  an  electromagnetic  sensor  sys¬ 
tem  and  immersed  in  a  virtual  town  in  which  they  could  move  forward  by  pressing  a  mouse  button. 
Subjects  had  to  turn  on  their  own  vertical  axis  in  order  to  change  the  direction  of  heading  in  the  vir¬ 
tual  town.  Their  task  was  to  locate  different  landmarks  and  become  familiar  with  the  town.  In  the  AVis 
condition  subjects  were  equipped  with  the  head-mounted  display  and  headphones,  which  delivered  a 
soundscape  updated  in  real  time  according  to  their  movement  in  the  virtual  town.  The  sounds  were 
produced  through  tracked  binaural  rendering  (HRTF). 

The  two  groups  of  subjects  exhibited  better  scores  of  presence  in  the  AVis  condition,  although  pa¬ 
tients  exhibited  more  cybersickness  symptoms  than  normal  subjects  in  this  condition.  While  normal 
subjects  preferred  the  AVis  condition,  expressing  a  better  sense  of  realism,  patients  did  not  mention 
such  a  preference.  Overall,  this  study  might  reflect  the  multisensory  integration  deficit  of  anxious  pa¬ 
tients  and  underline  the  need  for  further  research  on  multimodal  VR  systems  for  clinical  use. 


INTRODUCTION: 

The  specific  feature  of  VR  compared  to  tradi¬ 
tional  displays  is  that  the  environments  it  pro¬ 
vides  are  places  where  as  many  senses  as  pos¬ 
sible  are  meant  to  be  active.  “Multisensory”  is  a 
keyword  for  virtual  reality.  The  number  of  sen¬ 
sory  modalities  through  which  the  user  is  cou¬ 
pled  to  the  virtual  environment  is  a  main  factor 
contributing  to  the  feeling  of  presence.  In  spite 
of  that,  VR  technologies  rarely  integrate  the 
auditory  modality,  which  is  the  only  sense 
through  which  we  are  communicating  with  the 
whole  space  around  us. 

Psychiatric  patients  commonly  report  a  hyper¬ 
sensitivity  to  auditory  stimuli,  while  pure  tone 
audiograms  show  generally  normal  hearing. 
Sound  tolerance  is  influenced  by  stress  and 
tiredness,  and  specific  sounds  can  cause  physi¬ 
cal  pain  and  nerve  grating1.  There  is  a  correla¬ 


tion  between  loudness  tolerance  and  anxiety2, 
and  strong  emotional  reactions  can  easily  be 
elicited  through  hearing3.  It  is  therefore  all  the 
more  interesting  to  integrate  the  auditory  modal¬ 
ity  in  a  realistic  way  when  working  with  anxious 
patients,  and  to  understand  in  which  way  it  can 
be  used  for  therapeutic  purposes. 

Several  studies  have  led  to  the  observation  that 
patients  with  agoraphobia,  panic  disorder,  or 
space  and  motion  discomfort  (SMD)  may  have 
a  problem  with  multisensory  integration:  sub¬ 
jects  with  symptoms  of  panic  disorder  and  ago¬ 
raphobia  are  destabilized  under  conflicting  sen¬ 
sory  conditions  while  maintaining  upright  pos¬ 
ture4,  5,e.  Previous  studies  creating  conflicts  be¬ 
tween  vestibular  and  visual  information  with  a 
VR  setup  attempted  to  demonstrate  that  abnor¬ 
mal  central  processes  of  multisensory  integra¬ 
tion  in  maintaining  balance  in  anxiety  disorders 
was  not  restricted  to  balance  control2,8.  By  inte- 
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grating  the  auditory  modality  to  a  VR  setup,  it  is 
a  more  general  question  as  to  whether  mul- 
tisensory  integration  in  anxiety  can  be  ad¬ 
dressed.  Without  any  additional  sensory  conflict 
than  the  one  which  is  inherent  to  a  VR  set-up 
(due  to  the  delay  in  feedback  between  action 
and  consequences  of  actions  in  the  virtual  envi¬ 
ronment  -VE),  how  do  anxious  patients  cope 
with  interactive  auditory  modality?  Would  the 
introduction  of  the  auditory  modality  generate 
sensory  enhancement  or  sensory  overload? 

The  study  we  present  here  involves  technolo¬ 
gies,  models  and  applications  linked  to  the  intro¬ 
duction  of  3D  sound  in  virtual  or  augmented 
reality  environments.  Auditory  augmentation  of 
visual  environments  is  known  to  improve  pres¬ 
ence  and  immersion.  It  also  appears  very  prom¬ 
ising  in  creating  user-friendly  information  sys¬ 
tems  accessible  to  everybody.  To  create  such 
an  environment  and  the  corresponding  content, 
several  concepts  and  technologies  need  to  be 
researched,  developed,  and/or  integrated.  The 
introduction  of  3D  sound  modality  also  ad¬ 
dresses  the  need  for  a  better  understanding  of 
multisensory  integration  mechanisms.  This  in¬ 
cludes  complementarities  or  conflict  between 
the  auditory  and  visual  senses  and  also  with 
idiothetic  cues  (cues  generated  through  self- 
motion,  including  vestibular  and  proprioceptive 
information).  These  last  aspects  are  important 
since  many  applications  can  now  involve  user 
navigation  in  a  virtual  or  augmented  world,  or 
perception-action  cues  provided  by  interactive 
devices. 

The  most  natural  audio  technique  for  virtual  re¬ 
ality  applications  is  the  binaural  rendering  on 
headphones  that  relies  on  the  use  of  HRTFs 
(HRTF  refers  to  Head  Related  Transfer  Func¬ 
tion,  which  is  a  set  of  filters  measured  on  an 
individual  or  artificial  head  and  used  to  repro¬ 
duce  all  the  directional  cues  involved  in  auditory 
localization).  This  technique  still  needs  some 
studies  to  overcome  its  implementation  cost  and 
individual  adaptation  limitations  (a  fully  convinc¬ 
ing  spatial  rendering  requires  the  use  of  HRTFs 
measured  on  the  listener's  head). 

Incorporating  real-time  updated  3-D  sound  to 
virtual  reality  technologies  therefore  addresses 
several  practical  issues.  If  there  is  a  consensus 
on  the  fact  that  presence  is  improved  by  3-D 
sound,  little  is  known  about  how  an  auditory  VE 


should  be  designed  so  that  it  does  not  interfere 
with  the  visual  VE.  We  thus  conducted  a  study 
to  provide  information  about  the  importance  of 
auditory  feedback  in  a  VR  system  planned  for 
clinical  use,  as  well  as  one  which  would  provide 
information  about  the  different  factors  which 
should  be  taken  into  account  to  build  a  multimo¬ 
dal  VE  (sense  of  realism,  presence,  and  coher¬ 
ence  between  the  visual  and  auditory  VE). 

If  agoraphobic  patients  are  effectively  more  sen¬ 
sitive  to  sensory  conflicts  than  normal  subjects, 
then  multisensory  feedback  in  VR  could  repre¬ 
sent  a  challenge  for  them.  However,  since  pres¬ 
ence  during  a  bimodal  stimulation  should  be 
higher,  this  might  provide  an  interesting  way  to 
convey  supplementary  spatial  information  and 
engage  patients  in  a  task.  We  conducted  a 
study  in  which  we  compared  navigation  per¬ 
formances  in  a  virtual  town  in  two  immersive 
conditions:  visual  alone  (Vis)  and  auditory-visual 
(AVis).  We  intended  to  test  the  emotional  and 
behavioral  reaction  of  patients  sensitive  to 
space  and  of  normal  subjects  to  these  two  kinds 
of  virtual  stimulation  in  order  to  develop  new 
procedures  and  find  an  integrated  approach  to 
work  with  vision  and  audition  in  VR. 

MATERIAL  AND  METHODS: 

Design 

All  subjects  included  in  the  comparative  study 
received  two  sessions  of  virtual  navigation.  The 
order  of  sessions  was  counterbalanced  so  that 
the  same  number  of  subjects  began  the  trial 
with  AVis  and  Vis  conditions.  Sessions  were 
performed  at  least  one  week  apart.  After  each 
session,  subjects  had  to  complete  several  ques¬ 
tionnaires  and  2  memory  tests  related  to  their 
experience.  In  the  first  test,  they  were  presented 
a  survey  view  of  the  virtual  town  and  had  to  lo¬ 
cate  the  different  landmarks  they  were  asked  to 
find  during  navigation.  In  the  second  test,  they 
were  submitted  to  a  2-choice  forced  recognition 
task,  during  which  they  were  presented  1 0  pairs 
of  snapshots  and  were  required  to  chose  be¬ 
tween  a  view  taken  in  the  virtual  town  they  had 
navigated  in  and  a  view  taken  in  another  town. 

The  measures  taken  during  the  navigation  were 
the  number  of  landmarks  found  (score  on  11) 
and  the  time  spent  in  the  virtual  town.  The 
measures  taken  after  navigation  were  the  num- 
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ber  of  correctly  localized  landmarks  on  the  sur¬ 
vey  view  of  the  virtual  town  (score  on  12)  and 
the  number  of  correct  answers  to  the  2-choice 
forced  recognition  task  (score  on  10).  Partici¬ 
pants  were  debriefed  after  each  session  but 
were  not  informed  about  the  content  of  the  fol¬ 
lowing  session.  At  the  end  of  the  second  ses¬ 
sion  and  after  the  debriefing  they  were  informed 
about  the  differences  between  the  two  condi¬ 
tions  if  they  had  not  noticed  it. 

Procedure 


swing,  bus  stops,  see  Figure  1)  and  become 
familiar  with  the  town.  In  the  AVis  condition  sub¬ 
jects  were  equipped  with  the  head-mounted 
display  and  headphones,  which  delivered  a 
soundscape  updated  in  real  time  according  to 
their  movement  in  the  virtual  town.  The  sounds 
were  produced  through  tracked  binaural  render¬ 
ing  (non-individual  HRTF)  and  were  dependent 
upon  the  subject’s  movements. 

Subjects 

Patients  were  individuals  suffering  from  agora- 


Subjects  were  equipped  with  a  head-mounted 
display  coupled  with  an  electromagnetic  sensor 
system  and  immersed  in  the  virtual  town  in 
which  they  could  move  forward  by  pressing  a 
mouse  button.  Subjects  had  to  turn  on  their  own 
vertical  axis  in  order  to  change  the  direction  of 
heading  in  the  virtual  town.  Their  task  was  to 
locate  different  landmarks  (movie  theater, 


phobia  as  their  main  complaint.  Seventeen  pa¬ 
tients  were  referred  to  us  for  the  study  at  the 
local  day  hospital  (12  females,  5  males).  Two  of 
them  were  excluded  from  the  following  analysis 
since  their  fear  of  empty  spaces  was  so  severe 
that  they  could  not  accomplish  the  task.  Five 
patients  stopped  the  protocol  after  the  first  ses¬ 
sion  (3  females,  2  males).  The  remaining  10 


patients  completed  the  project  (7  females,  3 
males).  Nine  control  subjects  (7  females,  2 
males)  were  included  in  the  study.  The  mean 
ages  of  the  anxious  and  control  samples  were 
35.3  (SD  10.2)  and  32.7  years  (SD  10.6),  re¬ 
spectively.  The  control  participants  were  not 


afflicted  with  any  mental  disorders.  A  semi- 
structured  interview  based  on  the  Mini  Interna¬ 
tional  Neuropsychiatric  Interview  was  adminis¬ 
tered  to  all  the  participants  to  ensure  that  they 
met  these  criteria. 

Questionnaires  and  Interview  Measures 

The  state  portion9  of  the  STAI  was  used  to 
measure  the  anxiety  levels  upon  arrival  at  the 
laboratory  and  after  completion  of  the  experi¬ 
ment.  A  22-item  cybersickness  scale  was  used 
to  assess  the  level  of  discomfort  after  exposure 
to  VR.  It  comprised  a  list  of  symptoms  and  sen¬ 
sations  associated  with  autonomic  arousal 
(nausea,  sweating,  heart  pounding,  etc.),  vesti¬ 
bular  symptoms  (dizziness,  fainting,  etc.),  respi¬ 
ratory  symptoms  (feeling  short  of  breath,  etc.) 
and  could  also  be  used  to  estimate  signs  of 
somatisation  (tendency  to  complain  of  a  large 
number  of  diverse  symptoms).  Items  were  rated 
on  a  scale  from  0  to  4  (absent,  weak,  moderate, 
strong).  The  presence  questionnaire  from  the  I- 
group10  was  presented  after  completion  of  the 
experiment. 

Visual  and  Auditory  stimuli 

The  3D  visual  environment  was  based  on  a  3D 
model  developed  by  Sense8  Corp  (San  Rafael, 
CA).  It  was  composed  of  noticeable  landmarks, 
several  streets  and  alleys,  and  was  rendered 
using  Virtools  Dev  2.5  (Virtools  SA,  Paris, 
France).  This  software  has  limited  features  in 
terms  of  auditory  design,  which  consists  mainly 
of  stereo  rendered  sources,  even  if  specific 
plug-ins  may  be  also  implemented.  In  order  to 
allow  the  maximum  flexibility  with  regards  to 
sound  design,  we  used  the  Spat~  sound  render¬ 
ing  engine11, 12  and  the  ListenSpace  auditory 
scene  authoring  tool13;  both  developed  at  Ircam. 
A  specific  network  interface  was  developed  in 
order  to  connect  Virtools  with  ListenSpace  and 
Spat~,  enabling  the  transmission  of  position 
coordinates  and  rotation  angles  of  the  user’s 
head  in  the  virtual  world.  The  sounds  were  pro¬ 
duced  through  tracked  binaural  rendering 
(HRTFs)  and  were  dependent  upon  the  sub¬ 
ject’s  movements. 

The  model  used  for  the  audio  environment  was 
almost  static;  sound  sources  and  their  activation 
zones  did  not  move.  Only  the  movement  and 
position  of  the  subject  drove  audio  events  and 


their  spatialization  according  to  their  relative 
coordinates.  Two  types  of  auditory  elements 
were  used;  binaurally  rendered  monophonic 
sources  and  ambisonics  sound  scenes  (Figure 
2).  Binaurally  rendered  monophonic  sources 
were  put  at  precise  locations  in  the  scene.  The 
ListenSpace  environment  made  it  possible  to 
program  the  position  of  these  sources,  and  to 
define  the  small  activation  areas  where  the 
sources  could  be  heard.  Ambisonics  sound 
scenes,  linked  to  large  activation  areas,  were 
added  to  the  soundscape.  Ambisonics  is  a  4 
channel  audio  format  that  embodies  spatial  in¬ 
formation  of  a  sound  scene  according  to  the  3 
directions  of  space  (left/right,  front/back  and 
up/down),  thus  allowing  a  full  immersion  of  the 
listener  inside  an  auditory  environment.  The 
ambisonics  sound  scenes  were  recorded  using 
the  dedicated  ST  250  Soundfield  microphone  in 
an  urban  environment,  which  corresponded  well 
to  the  visual  context  of  the  experiment.  These 
sound  scenes  were  decoded  in  real  time  for  a 
reproduction  over  headphones,  according  to  the 
listener's  position  in  the  virtual  space.  The  large 
activation  areas  covered  the  whole  town,  so  that 
the  subject  was  either  at  the  center  of  at  least 
one  sound  scene,  or  in  a  cross-fade  region  be¬ 
tween  two  sound  scenes.  The  cross-fade 
mechanism  was  tuned  to  ensure  smooth  transi¬ 
tions  between  the  4  sound  scenes. 

Virtual  Reality  Set-Up  Specifications 

We  used  a  V8  head-mounted  display  (Virtual 
Research  Systems,  Santa  Clara,  CA).  The  LCD 
displays  had  a  monocular  field  of  view  of  48°  by 
36°,  with  an  array  of  640x480  (true  VGA)  color 
triads  (pixels),  refreshed  at  60  frames  per  sec¬ 
ond.  The  subject’s  head  orientation  was  meas¬ 
ured  by  an  electromagnetic  sensor  system 
(Fastrak  Polhemus)  which  has  an  update  rate  of 
120  Hz.  The  image  generator  (Pentium  IV 
2.4GHz,  512  megabytes  of  RAM  and  an  NVIDIA 
Quadro4  750  XGL  graphics  card)  took  the  head 
angular  position  information  from  the  tracker 
and  sent  the  corresponding  image  to  the  display 
and  to  ListenSpace  (Pentium  IV  2.4GHz),  which 
calculated  the  position  of  the  sound  sources 
with  respect  to  the  head  angular  position  infor¬ 
mation  and  sent  them  to  the  Spat~  (Mac  1GHz), 
which  generated  the  sound.  The  Mac  was 
equipped  with  a  Hammerfall  DSP  system. 
Sennheiser  HD570  circum-aural  open  head¬ 
phones  were  used  in  the  AVis  condition. 
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Statistical  analysis 

To  assess  the  effect  of  auditory  modality  in  the 
procedure,  repeated  measures  ANOVAs  (2  x  2) 
were  performed  on  the  different  scores  as  the 
dependent  variable,  with  condition  (Vis  and 
AVis)  as  a  within-subjects  factor  and  with  group 
(patients  and  control)  as  between-subjects  fac¬ 
tor.  The  effect  of  VR  session  on  state  anxiety 
was  evaluated  with  repeated  measures 
ANOVAs  (2  x  2  x  2).  To  check  for  a  potential 
presentation  order  of  conditions  effect  on  the 
different  variables,  repeated  measures  ANOVAs 
(2  x  2)  were  performed  on  the  different  scores 
as  the  dependent  variable,  with  presentation 
order  of  conditions  (Vis  first  and  AVis  first)  as  a 
between-subjects  factor  and  with  condition  (Vis 
and  AVis)  as  a  within-subjects  factor.  Non- 


parametric  statistical  tests  were  used  when 
needed. 

RESULTS: 

Of  the  1 7  recruited  patients,  as  mentioned  be¬ 
fore  2  females  had  to  be  excluded  because  of 
strong  emotional  reactions.  Interestingly,  the 
protocol  served  as  a  therapy  for  the  two  of 
them,  who  eventually  managed  to  perform  part 
of  the  navigation  task  at  the  end  of  the  second 
session  (with  2  landmarks  found).  Five  patients 
completed  only  one  session.  Two  did  an  AVis 
condition  (2  females),  3  did  a  Vis  condition  (1 
female,  2  males).  Only  the  10  patients  who 
completed  two  sessions  were  included  in  the 
comparative  analysis  (see  Table  1). 


Figure  2.  Auditory  environment  in  AVis  condition 

The  sounds  are  played  according  to  the  computed  position  and  distance  of  the  subject  with  respect 
to  the  source  when  he/she  enters  an  activation  area.  Large  activation  areas:  ambisonic  sounds  sce¬ 
nes  (4  channels  audio  format)  recorded  in  a  urban  environment.  Small  activation  areas:  binaurally 
rendered  monophonic  sources. 
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Presence 

The  two-way  ANOVA  with  condition  as  a  within- 
subjects  factor  and  with  group  as  between- 
subjects  factor  on  presence  scores  indicated  a 
main  effect  of  condition  (F(1,17)=7.3,  p=0.01). 
Presence  scores  were  higher  in  the  AVis  condi¬ 
tion  in  both  groups  of  subjects  (Table  1).  The 
analysis  of  variance  with  condition  as  a  within- 
subjects  factor  and  with  presentation  order  of 
conditions  as  a  between-subjects  factor  indi¬ 
cated  only  a  main  effect  of  condition 
(F(1,17)=9.29,  p<0.01).  However,  the  interac¬ 
tion  between  presentation  order  and  condition 
was  marginally  significant  (F(1,17)=4.1, 
p=0.06).  Indeed,  presence  scores  increased 
during  the  second  session  only  in  Vis  first  pres¬ 
entation  order.  In  AVis  first  presentation  order, 
presence  scores  decreased  during  the  second 
session  (for  Vis  first,  Vis=39.6,  SD=15.2, 
AVis=41.7,  SD=18.7;  for  AVis  first,  AVis=41, 
SD=15,  Vis=30.7,  SD=14.7).  This  observation  is 
in  agreement  with  the  finding  that  auditory  mo¬ 
dality  improves  the  sense  of  presence,  since 
removing  it  has  the  opposite  effect. 

Cybersickness 

The  ANOVA  with  condition  as  a  within-subjects 
factor  and  with  group  as  a  between-subjects 
factor  on  cybersickness  scores  showed  an  inter¬ 
action  between  the  factors  group  and  condition 


(F(1 ,1 7)=1 0.6,  p<0.01).  Cybersickness  scores 
significantly  increased  in  AVis  condition  in  pa¬ 
tients  group.  It  is  unlikely  that  these  scores  rep¬ 
resent  mainly  signs  of  somatisation  since  there 
is  no  difference  between  the  two  groups  of  sub¬ 
jects  in  the  Vis  condition.  The  analysis  of  vari¬ 
ance  with  condition  as  a  within-subjects  factor 
and  with  presentation  order  of  conditions  as  a 
between-subjects  factor  indicated  only  a  main 
effect  of  condition  (F(1 ,1 7)=6.1 ,  p<0.05). 

State  anxiety  levels 

The  two  groups  differed  in  all  measures  of  state 
anxiety  (Table  2).  A  three-way  analysis  of  vari¬ 
ance  with  two  repeated  measures  on  condition 
and  the  two  state  anxiety  scores  (before  and 
after  the  VR  session)  was  performed  between 
the  two  groups  (2  x  2  x  2).  The  analysis  indi¬ 
cated  a  main  effect  of  group  (F(1,17)=12.9, 
p<0.01)  but  there  was  no  interaction  between 
the  different  factors,  suggesting  that  state  anxi¬ 
ety  levels  before  and  after  the  VR  session  were 
not  different  for  any  of  the  groups. 

Navigation  in  Vis  and  Avis  condition 

No  difference  between  the  groups  nor  between 
the  conditions  was  found  in  the  two  measures 
taken  during  navigation  (time  spent  in  VR  and 
number  of  landmarks  found).  The  analysis  of 
variance  with  condition  as  a  within-subjects  fac- 


Table  1.  Means  and  (SD)  of  the  scores  to  the  different  measures  related  to  VR  according  to  the 
group  and  the  condition. 


Vis  condition 

AVis  condition 

Measure 

HUSI 

Control  group 

(n=9) 

IMUI 

Time  in  VR  (in  sec) 

474  (206) 

509  (194) 

469  (170) 

428  (211) 

Landmarks  found  during 
navigation  (Max=11) 

9.7  (2.9) 

8.6  (2.9) 

10.4  (1.1) 

8.9  (3.8) 

2-choice  forced  recognition 
(Max=10) 

6.9  (2.0) 

7.3  (1.1) 

Correctly  localized  land¬ 
marks  (Max=12) 

'  7.3  (2.6 f 

6.9  (2.8) 

5.1  (3.3)  | 

Cybersickness 

5.2  (5.3) 

6  (7.8) 

4.6  (6.2) 

18.8  (14.6) 

Presence 

32.4  (13.1) 

38  (17.2) 

40  (14. 1) 

42.6  (19.2) 

aWilcoxon  rank  test,  t=3,  p<0.05 
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Control  Group  (n=9)  Patient  Group  (n=1 0) 

Vis  condition  AVis  condition  Vis  condition  AVis  condition 


Time 

Mean 

SD 

Mean 

SD 

Mean 

SD 

Mean 

SD 

Before  the  session 

mom 

rai 

33 

8.6 

At  the  end  of  session 

HI 

10.2 

37 

10.8 

Table  2.  State  anxiety  levels  at  the  beginning  of  and  after  completing  a  session 


tor  and  with  presentation  order  of  conditions  as 
a  between-subjects  factor  indicated  an  interac¬ 
tion  between  presentation  order  of  conditions 
and  condition  on  time  spent  in  VR 
(F(1,17)=11.6,  p<0.01).  Indeed,  time  spent  in 
VR  always  decreased  during  the  second  ses¬ 
sion,  but  time  spent  in  VR  during  the  first  ses¬ 
sion  was  much  shorter  in  the  case  of  AVis  first 
(for  Vis  first,  Vis=573,  SD=149  sec,  AVis=438 
sec,  SD=162;  for  AVis  first,  AVis=462  sec, 
SD=220,  Vis=403  sec,  SD=209).  Since  time 
spent  in  VR  is  a  measure  of  time  to  find  the 
landmarks  and  to  feel  familiarity  with  the  town, 
this  indicates  that  AVis  condition  does  provide 
more  efficiency  in  spatial  exploration. 

Correctly  localized  landmarks 
(after  navigation) 

No  difference  between  the  groups  nor  between 
the  conditions  was  found.  The  analysis  of  vari¬ 
ance  with  condition  as  a  within-subjects  factor 
and  with  presentation  order  of  conditions  as  a 
between-subjects  factor  indicated  an  interaction 
between  presentation  order  and  condition 
(F(1 ,1 7)=1 2.9  p<0.01).  Performance  always 
increased  for  the  second  session,  but  the  in¬ 
crease  is  higher  when  the  first  session  was  in 
AVis  condition  (for  Vis  first,  Vis=5.1,  SD=3.3, 
AVis=6.5,  SD=3.1;  for  AVis  first,  AVis=5.3, 
SD=3.3,  Vis=7.2,  SD=2.7). 

Two-choice  forced  recognition 
(after  navigation) 

No  difference  between  the  groups  or  between 
the  conditions  was  found  with  either  analysis  of 
variance.  However,  the  interaction  between 
group  and  condition  was  marginally  significant 
(F(1,17)=3.04,  p=0.09).  While  normal  subjects’ 


performance  tended  to  increase  in  AVis  condi¬ 
tion,  patients’  performance  tended  to  decrease 
in  comparison  with  performance  in  Vis  condi¬ 
tion.  No  presentation  order  effect  could  explain 
this  observation. 

DISCUSSION: 

In  the  present  experiment,  we  compared  navi¬ 
gation  in  a  visual  VE  with  navigation  in  an  audi¬ 
tory-visual  VE  in  two  samples  of  subjects.  As 
expected,  presence  scores  were  significantly 
higher  in  AVis  condition.  Presentation  order  of 
conditions  was  not  at  stake  in  this  result,  since 
the  order  of  sessions  was  counterbalanced 
across  subjects.  However,  analysis  of  the  effect 
of  presentation  order  pointed  to  a  beneficial  ef¬ 
fect  of  auditory  modality:  time  spent  in  VR  to 
find  the  landmarks  was  shorter  in  AVis  first  or¬ 
der,  the  increase  of  number  of  correctly  local¬ 
ized  landmarks  at  the  end  of  the  second  ses¬ 
sion  was  higher  in  AVis  first  order. 

The  two  groups  behaved  differently  with  regard 
to  the  two  conditions.  While  normal  subjects  did 
not  exhibit  more  signs  of  cybersickness  in  AVis 
condition,  the  level  of  discomfort  of  anxious  pa¬ 
tients  was  significantly  higher  in  this  condition. 
In  addition,  anxious  patients  had  poorer  per¬ 
formances  at  a  visual  recognition  test  in  AVis 
condition.  These  results  are  in  agreement  with 
the  hypothesis  of  a  multisensory  integration 
deficit  in  this  population.  The  attempt  to  continu¬ 
ously  adjust  the  relative  weighting  of  auditory, 
visual,  and  idiothetic  information  may  have 
caused  an  attention  load  which  prevented  allo¬ 
cation  of  attention  resources  to  the  VE. 

In  the  setup  we  used,  the  imperfect  mapping 
between  the  motor  outflow  and  the  multiple  sen- 
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sory  feedbacks  (movement  of  the  head  and  its 
visual  and  auditory  feedbacks)  can  be  the 
cause  of  the  increased  symptoms  of  cybersick¬ 
ness  in  the  AVis  condition.  It  exhibited  the  sig¬ 
nificance  of  mastering  the  delay  between  sound 
and  images  updating  so  that  no  supplementary 
conflict  is  introduced. 

The  present  experiment  confirmed  the  impor¬ 
tance  of  3D  audio  for  the  construction  of  a  vir¬ 
tual  space.  Control  subjects  said  that  the  experi¬ 
ence  was  more  compelling  when  3D  auditory 
information  was  delivered  during  the  virtual 
navigation,  while  several  patients  reported  that 
the  two  worlds  (auditory  and  visual)  could  not 
fulfill  a  sense  of  realism  when  presented  to¬ 
gether.  The  visual  world  we  were  using  was 
composed  of  rich  textures  attempting  to  model  a 
realistic  urban  environment.  The  auditory  world 
was  mainly  composed  of  ambisonic  sounds  re¬ 
corded  in  a  city,  which  corresponded  to  highly 
textured  sounds.  In  spite  of  the  equivalent  rich¬ 
ness  of  both  channels,  anxious  patients  tended 
to  perceive  them  separately.  If  this  mode  of  per¬ 
ception  can  be  linked  to  a  sensory  overload 
originating  from  their  high  sensitivity  to  multisen- 
sory  information,  a  question  remains  about  the 
sensation  of  coherence  at  the  semantic  level 
between  the  visual  scene  and  the  auditory 
scene14.  Focusing  on  this  issue,  we  are  cur¬ 
rently  conducting  an  experiment  in  which  the 
visual  environment  is  purely  symbolic.  Assum¬ 
ing  that  patients  would  not  have  a  dual  mode  of 
perception  in  a  symbolic  VE,  it  might  be  possi¬ 
ble  to  unravel  primitives  that  might  be  sufficient 
to  elicit  emotional  reactions,  presence  and  reha¬ 
bilitation. 

Computationally  it  is  currently  easier  to  achieve 
high  resolution  and  realism  in  an  auditory  VE 
than  in  a  visual  VE.  In  an  attempt  to  address 
this  issue,  we  conducted  a  trial  on  4  patients 
who  were  asked  to  navigate  blindfolded  in  an 
auditory  only  VE  and  were  surprised  to  observe 
that  time  of  immersion  tremendously  increased 
(patients  were  willing  to  explore  the  VE  as  long 
as  possible)  while  navigation  was  efficient  (all 
auditory  landmarks  were  found).  Furthermore, 
realism  was  judged  as  very  high  and  patients 
produced  an  accurate  graphic  reproduction  of 
layout  of  auditory  landmarks.  This  condition 
seems  therefore  promising  for  research  in 
therapeutic  methods  in  which  VR  should  not 
limit  its  aim  to  copy  reality  but  should  invent  new 


ways  to  engage  the  immerged  subject.  Applied 
research  with  virtual  sound  has  been  performed 
in  the  last  decade  in  order  to  allow  the  visually 
impaired  to  develop  more  accurate  and  exten¬ 
sive  knowledge  of  spatial  layout15,16.  Hopefully 
this  kind  of  VR  will  provide  therapeutic  benefit 
for  all  kinds  of  populations. 
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ABSTRACT :  In  this  paper,  a  pilot  study  on  the  relationship  between  significant  information,  presence, 
and  stress  in  virtual  environments  is  presented.  The  experiment  shown  in  this  work  was  performed  with 
a  Medical  Emergency  Training  Simulator  based  on  virtual  reality,  and  was  conducted  with  two  sets  of 
subjects:  critical  care  specialists  and  people  without  experience  in  medicine,  trained  to  properly  act  with 
the  concrete  clinical  problem  being  simulated.  During  the  experiment,  the  Galvanic  Skin  Response 
(GSR)  of  the  subjects  was  recorded,  and  presence  and  stress  questionnaires  were  completed  by  the 
subjects.  This  study  found  that  results  from  stress  and  presence  measurements  show  an  evident  corre¬ 
lation,  making  apparent  a  close  relationship  between  both  variables.  Our  results  also  show  the  impor¬ 
tance  of  significant  information  when  a  high  degree  of  presence  or  stress  is  needed  in  a  VR  Training 
Simulator. 


1.  INTRODUCTION: 

Intensive  care  specialists  are  needed  to  work  in 
critical  situations  under  high  levels  of  stress. 
This  kind  of  strain  has  a  great  importance  in  the 
emotional  state  of  the  medical  specialist,  and 
so,  they  have  to  be  prepared  to  work  in  such 
adverse  conditions.  Hence,  training  simulators 
in  this  field  must  not  only  provide  an  environ¬ 
ment  to  teach  cognitive  skills  necessary  for  pa¬ 
tient  assessment,  they  also  need  to  elicit  that 
emotional  state  in  the  subject.  In  order  to 
achieve  those  capabilities,  training  simulators 
can  use  Virtual  Reality  (VR)  technology,  which 
may  induce  more  intense  feelings  in  the  trainee. 

In  this  context,  presence,  as  a  subjective  sense, 
has  been  argued  to  be  a  very  important  factor 
for  human  performance  in  general  VR  systems1. 
Furthermore,  studies  on  this  subject  have  found 
a  relationship  between  the  level  of  presence 
and  stress2,4.  If  the  recreated  virtual  environ¬ 
ment  presents  a  stressful  situation,  a  high  de¬ 
gree  of  presence  will  yield  a  high  level  of 
stress4, 5.  So,  in  this  kind  of  environment,  stress 
measurements  could  be  used  as  an  indirect 


presence  indicator.  But  we  can  go  further  by 
hypothesizing  that  eliciting  stress  in  the  subjects 
exposed  to  a  virtual  experience  will  help  to 
achieve  higher  degrees  of  presence.  This  last 
hypothesis  is  discussed  in  this  paper. 

In  addition,  in  this  work  we  study  how  significant 
information  presented  in  the  virtual  world  con¬ 
cerns  the  elicited  stress  and  presence.  The 
same  stimuli  can  provoke  very  different  reac¬ 
tions  depending  on  the  significance  of  the  pre¬ 
sented  information.  For  a  medical  specialist  with 
real  experience  in  critical  care,  a  virtual  patient 
evokes  feelings  and  memories  that  can  in¬ 
crease  both  stress  and  presence.  However, 
subjects  without  that  real  experience  tend  to 
respond  in  a  different  way,  even  with  the  same 
environment  and  stimuli. 

This  paper  is  organized  as  follows:  Section  2 
describes  methodology  and  tools  used  in  the 
experiment.  Section  3  presents  the  obtained 
results  and  discusses  them.  Finally,  in  Section  4 
these  results  are  discussed,  and  in  Section  5 
conclusions  obtained  from  this  work  are  pre¬ 
sented,  as  well  as  future  research  goals. 
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2.  METHOD  AND  TOOLS: 

2. 1  Training  Simulator  Description. 

The  experiment  discussed  in  this  work  was  per¬ 
formed  with  UVIMO,  a  Medical  Emergency 
Training  Simulator  based  on  VR  and  developed 
for  this  research.  UVIMO  provides  a  virtual  envi¬ 
ronment  of  a  stressful  emergency  situation  with 
realistic  3D  graphics,  including  a  virtual  patient 
lying  down  on  the  floor,  medical  equipment 
placed  around  him,  and  the  complete  recreation 
of  a  typical  environment  in  which  the  action  oc¬ 
curs. 

Sense8  WorldToolKit  has  been  used  as  the 
simulation  engine.  A  Virtual  Research  V8  Head 
Mounting  Display  (HMD)  was  used  as  the  visu¬ 
alization  device,  and  an  Ascension  Technolo¬ 
gies  Flock  of  Birds  was  used  to  track  head 
movements. 

The  virtual  patient  was  presenting  an  acute 
myocardial  infarction,  with  a  clinical  history  of 
ischemic  cardiac  myopathy  and  diabetes.  He 
was  modeled  by  means  of  an  Expert  System, 
which  contained  the  rules  that  allow  the  patient 
to  respond  to  the  treatment  and  to  progress  by 
himself.  The  subjects  were  asked  to  treat  him 
within  UVIMO  in  two  different  scenarios:  a  quiet 
living  room,  and  a  noisy  street.  Figures  1  and  2 
show  a  snapshot  of  these  two  virtual  places. 
The  goal  of  this  choice  was  to  provide  a  non¬ 
stressful  environment,  and  a  stressful  one,  inde¬ 
pendently  of  the  action  to  be  carried  out  within 
them. 


Figure  1 .  Quiet  virtual  environment 


Figure  2.  Noisy  street  virtual  environment 


Interaction  was  managed  by  an  assistant,  who 
played  the  role  of  a  nurse,  receiving  orders  from 
the  subject  under  test.  The  subject  could  ask 
the  assistant  for  any  information  not  directly 
available  in  the  virtual  world,  like  arterial  pres¬ 
sure,  temperature,  etc.  In  addition,  the  assistant 
could  apply  any  treatment  the  subject  asks  for. 

2.2  Participants. 

The  experiments  were  done  with  a  total  of 
twelve  participants,  ranging  in  age  between  26 
and  47,  who  volunteered  for  this  study,  made  up 
of  5  males  and  7  females.  There  were  two  sets 
of  subjects:  critical  care  specialists  (aged  be¬ 
tween  31  and  47;  3  males,  3  females),  and  peo¬ 
ple  with  similar  academic  degrees  in  other  fields 
of  science,  and  without  experience  in  medicine 
(aged  between  26  and  33;  2  males,  4  females). 

The  former,  called  Group  A  from  now  on,  re¬ 
ported  less  experience  in  using  computer  than 
the  latter  one,  called  Group  B  from  now  on. 

Group  B  was  trained  in  a  one  hour  tutorial  about 
how  to  treat  this  specific  clinical  problem,  includ¬ 
ing  the  use  of  available  drugs  and  medical 
equipment,  as  well  as  their  effects  in  the  case  of 
inappropriate  application. 

2.3  Measurements. 

Two  main  types  of  measurements  were  taken: 
questionnaires  to  estimate  the  level  of  stress 
and  the  degree  of  achieved  presence,  and 
physiological  measurements  of  Galvanic  Skin 
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Response  (GSR).  In  addition,  significant  pos¬ 
tural  movements  and  attitude  changes  were 
annotated. 

2.3.1  Questionnaires. 

A  presence  questionnaire  by  Slater6,  translated 
into  Spanish,  was  used  to  estimate  the  degree 
of  presence  achieved  in  the  virtual  experience. 
The  original  questionnaire  consisted  of  five 
questions,  the  answers  to  which  were  rated 
from  1  to  7.  A  sixth  question  concerning  the  vir¬ 
tual  patient  was  added.  The  Presence  Index 
(PI)  was  taken  as  the  number  of  questions  rated 
as  6  or  7,  normalized,  and  expressed  as  a  per¬ 
centage: 

In  order  to  estimate  the  induced  stress,  the 
Stress  Arousal  Checklist  (SACL)  [7]  was  used. 
The  SACL  is  a  state  measurement  of  stress  and 
arousal.  In  other  words,  the  SACL  can  measure 
how  stressed  or  aroused  an  individual  is  at  any 
particular  time.  It  does  not  measure  a  person's 
tendency  to  be  stressed  or  aroused.  This  test 
gives  a  number  from  0  to  1 8  as  stress  index.  A 
normalized  index,  expressed  in  percentage,  is 

6 

S  Qj  ft  if  rate(i -  th  question)  >  5 

PI  =  i^ — *100;  Q.  H 
6  1 

[0  otherwise 

SACL  stress  index 

SI= - *100 
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2.3.2  Physiology. 

Galvanic  Skin  Response  (GSR)  of  the  subjects 
was  recorded  by  a  skin  conductance  module 
Coulbourn  V71-23,  using  DC  coupling,  a  sensi¬ 
tivity  of  100  mV/pS  and  two  8mm  AgCI/Ag  dis¬ 
posable  electrodes  placed  on  the  middle  and 
index  fingertips  of  the  left  hand  (all  the  subjects 
were  right  handed).  The  analog  signal  was  ac¬ 
quired  by  a  National  Instruments  NI-6036E  ac¬ 
quisition  card  and  a  software  tool  developed  for 
this  experiment. 

2.3.3  Behavioral  annotations. 

In  addition  to  the  above  measurements,  all  sig¬ 
nificant  postural  movements,  such  as  pointing 
or  trying  to  touch  virtual  objects,  were  noted. 
The  subjects’  attitude  to  the  assistant  was  also 


annotated.  The  idea  behind  this  is  that  involun¬ 
tary  movements  or  attitude  changes  may  be 
signs  of  high  presence. 

2.4  The  experiment. 

Before  starting  each  session,  the  subjects  were 
informed  about  the  methodology  of  the  experi¬ 
ment,  and  the  measurements  to  be  taken.  Each 
session  lasted  for  about  60  minutes,  consisting 
of  three  different  trials,  and  was  carried  out  with 
the  following  scheduling: 

-Estimation  of  stress  previous  to  the  experi¬ 
ence 

-Control  trial  (first  trial) 

-Estimation  of  stress  in  the  control  trial 
-Virtual  experience  in  the  quiet  environment 
(second  trial) 

-Estimation  of  stress  and  presence  in  the 
second  trial 

-Virtual  experience  in  the  noisy  environment 
(third  trial) 

-Estimation  of  stress  and  presence  in  the 
third  trial 
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GSR  was  measured  during  the  three  trials,  in¬ 
cluding  a  period  of  90  seconds  before  the  be¬ 
ginning  of  each  of  them,  to  obtain  the  baseline. 
During  this  time,  the  subject  was  asked  to  be  as 
relaxed  as  possible. 

2.4.1  Control  trial 

For  the  first  trial  a  task  was  chosen  which  did 
not  require  specific  knowledge  or  capabilities 
related  to  medicine.  Subjects  were  asked  to 
play  the  popular  game  ‘Simon’,  in  which  they 
had  to  reproduce  an  increasing  random  se¬ 
quence  of  colours  and  sounds.  This  trial  lasted 
for  4  minutes.  When  the  subject  failed  the  se¬ 
quence,  they  had  to  start  from  the  beginning 
again. 

2.4.2  Virtual  experience  in  the  quiet  environ¬ 
ment 

In  the  second  trial,  subjects  were  exposed  to 
UVIMO  in  a  quiet  living  room,  as  commented 
below  (see  Figure  1).  However,  it  was  not  a 
completely  silent  environment.  Beeps  from 
medical  equipment  could  be  heard,  as  well  as 
verbal  communication  between  subject  and  as¬ 
sistant.  This  trial  had  a  duration  of  3  minutes, 
independent  of  the  state  of  the  virtual  patient. 


2.4.3  Virtual  experience  in  the  noisy  environ¬ 
ment 

The  third  trial  took  place  in  a  noisy  street.  Sub¬ 
jects  were  exposed  again  to  UVIMO  in  that  en¬ 
vironment  (see  Figure  2).  This  trial  had  a  dura¬ 
tion  of  3  minutes,  independent  of  the  state  of 
the  virtual  patient.  In  this  case,  the  noise  acted 
as  a  stressful  element,  and  made  communica¬ 
tion  between  the  subject  and  the  assistant  more 
difficult. 

3.  RESULTS: 

3.1  Questionnaires 

The  SACL,  used  to  provide  a  stress  index  (SI), 
was  administered  four  times  to  each  subject: 
one  before  the  beginning  of  the  session  (Sl0),  as 
a  baseline  measurement,  and  one  immediately 
after  each  trial.  Let  the  increment  of  i-th  trial 
stress  index  (Slj)  relative  to  Sl0  be  defined  as: 

ASli  =  Sli  -  Sl0 

Figure  3  shows  ASli  for  both  groups  of  subjects. 
It  is  easily  seen  that  all  trials  produce  a  positive 
increment  of  stress.  The  control  trial  increases 
the  SI  in  a  small  amount,  10%  for  specialists 


Figure  3.  Increment  of  stress  index 
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2nd.  Trial 


3rd.  Trial 


Figure  4.  Presence  index 


and  4%  for  non-specialists.  It  is  important  to 
take  into  account  that  subjects  from  Group  A 
reported  significantly  less  use  of  computers  in 
their  work  than  subjects  from  Group  B,  which 
could  explain  this  difference. 

Similarly,  the  stressful  virtual  environment  elicits 
a  high  increase  of  SI,  approximately  30%  in 
Group  A  and  20%  in  Group  B.  The  obvious  dif¬ 
ference  between  the  two  groups  is  in  the  sec¬ 
ond  trial,  where  subjects  were  exposed  to 
UVIMO  within  a  quiet  virtual  environment.  Sub¬ 
jects  without  real  experience  in  critical  care  do 
not  show  much  more  increment  of  SI  than  in  the 
control  trial.  However,  subjects  with  that  experi¬ 
ence  present  increments  of  SI  that  are  similar  to 
those  in  the  third  trial. 

These  results  suggest  that  for  Group  B,  the  con¬ 
tent  of  virtual  experience  has  not  contributed  to 
increasing  SI.  However  the  noise  presented  in 
the  third  trial  acted  as  a  stressful  element,  which 
may  justify  the  high  ASI3.  However,  for  Group  A, 
the  content  seems  to  be  the  main  stressor,  as 
the  clinical  problem  was  the  same  in  the  second 
and  third  trials.  For  Group  A,  the  differing  trial  is 
clearly  the  first  one,  because  ASli  is  much  lower 

(GSR  -  GSR  Baseline) 

ACjoR  — - 

GSR  Baseline 


than  ASI2  and  ASI3. 

Figure  4  shows  the  obtained  presence  index 
(PI)  for  both  virtual  experiences  and  groups.  It  is 
clear  that  Group  A  presents  similar  PI  in  both 
experiences,  while  Group  B  reports  very  differ¬ 
ent  PI  in  both  trials.  The  first  trial  elicited  a  very 
low  level  of  presence  in  Group  B,  while  the  sec¬ 
ond  trial  provokes  a  similar  level  of  presence  in 
both  groups. 

The  correlation  between  our  measurements  of 
stress  and  presence  is  evident.  High  stress  lev¬ 
els  and  high  presence  indicators  are  clearly  as¬ 
sociated.  On  the  other  hand,  a  low  degree  of 
presence  is  also  associated  to  low  stress  meas¬ 
ures. 

3.2  Galvanic  Skin  Response 

GSR  was  recorded  for  all  subjects  so  as  to  ob¬ 
tain  an  objective  estimator  of  stress.  A  baseline 
period  of  90  seconds  was  recorded  before  star¬ 
ting  with  each  trial.  The  average  value  of  GSR 
over  this  period  has  been  taken  as  GSR  baseli¬ 
ne,  and  this  value  is  used  to  express  GSR  in  a 
relative  way,  skipping  the  great  inter-individual 
variability  of  raw  GSR.  So,  we  use  GSR*  defi¬ 
ned  as  Galvanic  Skin  Response. 
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Figure  5.  Galvanic  Skin  Response 


Figure  5  shows  the  tonic  level  of  AGSR  aver¬ 
aged  for  each  group  of  subjects,  every  ten  sec¬ 
onds.  In  continuous  lines,  the  three  trials  for 
Group  A  are  represented,  and  in  dashed  lines, 
the  three  trials  for  Group  B. 

The  first  remarkable  finding  is  the  sheer  rise 
after  the  first  ninety  seconds,  just  at  the  be¬ 
ginning  of  each  trial.  This  rise  is  clear  in  the 
three  trials  and  the  two  groups  of  subjects, 
but  in  Group  A  it  is  noticeably  larger.  It  is  ob¬ 
vious  that  GSR,  as  an  arousal  indicator,  in¬ 
creases  when  each  trial  begins.  The  differ¬ 
ences  between  Groups  A  and  B  can  not  be 
explained  by  the  special  significance  that  the 
simulated  situation  has  for  Group  A  subjects, 
because  that  difference  also  appears  in  the 
control  trial,  which  has  no  relation  with  medi¬ 
cal  activities.  As  commented  below,  Group  A 
reported  less  experience  with  computers  than 
Group  B.  This  could  be  the  reason  for  this 
higher  GSR  during  the  trials. 

In  Group  B,  a  slight  decrease  of  GSR  tonic  level 
can  be  seen  in  Trials  2  and  3,  while  not  in  the 
control  trial.  On  the  other  hand,  Group  A  pre¬ 


sents  the  opposite  effect.  But  the  high  variability 
of  these  signals  undermines  this  phenomenon 
in  itself.  Larger  groups  are  necessary  in  order  to 
confirm  or  discard  this  effect. 

Anyway,  it  is  clear  that  average  tonic  levels  of 
GSR  are  not  good  estimators  of  stress  or  of 
presence.  In  this  case,  tonic  level  of  GSR  can 
only  be  used  as  a  generic  arousal  index.  Al¬ 
though  it  can  sometimes  be  confused  with  an 
erroneous  stress  or  presence  index,  control  tri¬ 
als  confirm  that  this  is  not  the  case. 

3.3  Postural  movements 

During  Trials  2  and  3,  all  significant  movements 
of  subjects  were  annotated.  Although  it  is  diffi¬ 
cult  to  quantify  this  kind  of  behavior,  it  was  clear 
that  Group  A  subjects  made  more  significant 
movements  than  Group  B  while  exposed  to  the 
simulator.  They  include  pointing  to  virtual  ob¬ 
jects,  head  movements,  and  a  sharper  attitude 
with  the  assistant  when  the  virtual  patient  state 
was  more  complicated. 
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Group  B  subjects,  however,  were  much  more 
static  during  the  experience,  especially  during 
the  second  trial.  This  leads  to  suggest  that  pres¬ 
ence  was  greater  for  Group  A  than  for  Group  B. 


4.  DISCUSSION 

Subjects  from  Group  A,  specialists  in  critical 
care,  and  with  first  hand  experience  similar  to 
this  virtual  experience,  report  a  high  degree  of 
presence  in  both  environments.  However,  sub¬ 
jects  from  Group  B,  without  such  experience, 
have  a  high  degree  of  presence  only  in  the 
stressful  environment.  Hence,  the  information 
available  in  the  virtual  world  has  a  different 
meaning  for  the  former  than  for  the  latter,  even 
when  all  of  them  have  enough  knowledge  to  act 
within  the  virtual  world  in  a  proper  way. 

We  hypothesize  that  relationships  between  the 
virtual  world  and  experience  in  the  real  world 
could  play  a  very  important  role  in  eliciting  some 
emotional  engagement,  which  leads  to  in¬ 
creased  presence. 

In  addition,  a  strong  correlation  has  been 
found  between  increment  of  stress  and  pres¬ 
ence.  It  seems  to  be  clear  that  both  variables 
are  closely  related.  In  fact,  it  has  been  argued 
that  presence  could  be  a  stress  generator  if 
the  virtual  environment  is  stressful,  which  is 
a  very  reasonable  assumption.  However, 
Group  B  presents  very  different  degrees  of 
presence  in  both  quiet  and  noisy  environ¬ 
ments,  and  there  is  no  good  reason  for  this 
phenomenon  if  we  only  take  into  account  the 
differences  between  the  two  environments.  It 
can  be  argued  that  traffic  noise  makes  the 
second  environment  more  realistic,  as  it  pre¬ 
sents  multimodal  stimuli,  but  the  first  one  also 
has  visual  and  auditory  stimuli,  and  the  inter¬ 
action  with  the  assistant  is  based  on  a  con¬ 
versational  interchange.  In  addition,  sound  is 
coherent  with  the  virtual  world  in  both  cases. 

On  the  other  hand,  it  can  also  be  argued  that 
noise  and  consequent  difficulty  in  communicat¬ 
ing  with  the  assistant  is  a  clear  stressor,  and  so, 
the  increment  of  stress  in  Group  B  within  the 
noisy  environment  could  be  explained  by  the 
noise  itself.  Then,  the  increment  of  presence  in 
this  last  case  could  be  caused  by  the  stress, 
and  not  vice  versa. 


Postural  movements  seem  to  be  an  interesting 
indicator  of  presence,  as  pointed  out  by  other 
authors9,10.  Trials  in  which  a  high  index  of  pres¬ 
ence  was  measured  correspond  to  those  in 
which  subjects  made  more  involuntary  move¬ 
ments.  However,  it  is  necessary  to  define  a  pro¬ 
cedure  to  quantify  this  behavior  in  order  to  ob¬ 
tain  a  reliable  index  of  presence. 

Regarding  objective  measurements  based  on 
psychophysiological  signals,  the  use  of  aver¬ 
aged  GSR  to  assess  the  emotional  state  can  be 
found  in  the  literature10,11.  In  this  paper,  the  re¬ 
lationship  between  averaged  GSR,  stress,  and 
presence  has  been  explored.  It  has  been  shown 
that  averaged  GSR  can  not  be  used  as  a  stress 
nor  presence  index.  Here,  it  seems  that  GSR  is 
just  a  generic  arousal  index.  The  relationship 
between  this  arousal  and  stress  or  presence  is 
not  clear.  This  has  been  proven  by  means  of  a 
control  trial. 

5.  CONCLUSIONS  AND  FUTURE  WORK 

In  this  paper,  a  pilot  study  on  the  relationship 
between  significant  information,  presence  and 
stress  has  been  presented.  Our  results  suggest 
the  importance  of  significant  information  when  a 
high  degree  of  presence  or  stress  is  needed  in 
a  VR  Training  Simulator. 

Our  results  suggest  a  strong  and  close  relation¬ 
ship  between  increment  of  stress  and  presence, 
because  each  one  could  be  cause  and  conse¬ 
quence  of  the  other.  This  is  an  interesting  find¬ 
ing  because  we  can  include  some  stressors  in 
VR  simulators  in  order  to  improve  their  pres¬ 
ence  elicitation.  However  this  must  be  the  ob¬ 
jective  of  further  research  because,  as  sug¬ 
gested  in  Mosbruger12,  some  kinds  of  stress 
can  provoke  frustration  and  decrease  the  sense 
of  presence. 

Experience  in  the  use  of  computers  could  be  an 
important  variable  that  has  not  been  controlled 
enough  in  this  experiment.  Further  research 
should  treat  this  issue  very  carefully.  In  addition, 
stress  sources  must  be  better  isolated  in  order 
to  ensure  their  apparent  role  in  the  measured 
presence.  Moreover,  larger  groups  should  be 
considered.  The  work  presented  here  is  just  a 
pilot  experiment,  and  all  these  results  should  be 
considered  cautiously. 
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Abstract:  In  recent  years,  clinical  studies  have  begun  to  demonstrate  the  effectiveness  of  virtual  re¬ 
ality  (VR)  as  an  intervention  tool  in  rehabilitation.  There  are,  however,  a  number  of  important  issues 
that  must  be  addressed  in  order  to  determine  how  widely  VR-based  intervention  should  be  applied, 
and  the  ways  in  which  specific  patient  populations  can  benefit  from  its  unique  attributes.  One  of  the 
unresolved  issues  relates  to  how  the  characteristics  of  a  given  virtual  environment  affect  a  user's  per¬ 
formance  and  therapeutic  goals.  The  objective  of  this  study  was  to  compare  the  sense  of  presence, 
performance  and  perceived  exertion  experienced  by  users  when  they  engaged  in  two  games  per¬ 
formed  within  video-projected  virtual  environments  that  differed  in  their  level  of  structure  and  sponta¬ 
neity.  VividGroup’s  Gesture  Xtreme  (GX)  VR,  and  the  rehabilitation-oriented  application  of  GX  mar¬ 
keted  as  I  REX  (Interactive  Rehabilitation  and  Exercise)  were  used  to  deliver  the  virtual  environments. 
Thirty  healthy  male  and  female  participants,  aged  21  to  35  years,  experienced  the  same  two  virtual 
games  on  both  platforms.  A  mixed  design,  within  and  between  subjects  ANOVA  was  used  to  exam¬ 
ine  the  effect  of  movement  constraint  and  gender  as  well  as  the  interaction  between  these  variables 
on  the  sense  of  presence,  performance  and  perceived  exertion.  No  main  effect  or  interaction  effect 
was  found  for  the  sense  of  presence,  assessed  using  the  Presence  Questionnaire  (PQ),  although 
significant  differences  were  found  for  several  of  the  PQ  sub-scales.  A  main  effect  was  found  for  per¬ 
ceived  exertion  for  both  games,  however  in  the  opposite  direction.  We  conclude  that  it  is  possible  to 
provide  users  with  a  satisfactory  level  of  presence  and  enjoyment  using  both  structured  and  non- 
structured  paradigms.  However,  user  characteristics  such  as  gender,  as  well  as  the  therapeutic  ob¬ 
jectives,  should  be  taken  into  account  in  the  selection  of  a  suitable  application. 


INTRODUCTION: 

In  recent  years,  clinical  studies  have  begun  to 
demonstrate  the  effectiveness  of  virtual  reality 
(VR)  as  an  intervention  tool  in  rehabilitation. 
Among  its  advantages  is  the  opportunity  for  ex¬ 
periential,  active  learning  which  motivates  the 
participant1'2.  VR  also  offers  the  capacity  to  indi¬ 
vidualize  treatment  needs,  while  providing  in¬ 
creased  standardization  of  assessment  and  re¬ 
training  protocols.  Virtual  environments  can  also 
provide  repeated  learning  trials  and  offer  the 
capacity  to  gradually  increase  the  complexity  of 
tasks  while  decreasing  the  support/feedback 
provided  by  the  therapist3. 


METHODS: 

Participants 

Thirty  participants  (14  men  and  16  women) 
aged  21  -35  years  (mean  age  25.4  ±  3),  all  uni¬ 
versity  students,  volunteered  to  participate  in 
the  study. 

VR  Platforms 

The  non-structured  application  was  applied  us¬ 
ing  VividGroup’s  Gesture  Xtreme  (GX)  VR  sys¬ 
tem  (www.vividaroup.com1.  a  projected  video¬ 
capture  VR  platform  originally  developed  for 
entertainment  purposes  that  has  been  adapted 
for  use  in  rehabilitation10.  This  system  has  been 
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recently  used  in  rehabilitation  for  the  treatment 
of  motor  and  cognitive  impairments7'8,10'11.  Par¬ 
ticipants  stand  or  sit  in  a  demarcated  area  view¬ 
ing  a  large  monitor  that  displays  games  such  as 
touching  virtual  balls,  as  shown  in  the  left  panel 
of  Figure  1 .  A  single  camera  vision-based  track¬ 
ing  system  captures  and  converts  the  user’s 
movements  for  processing:  the  user's  live,  on¬ 
screen  video  image  corresponds  in  real  time  to 
his  movements.  The  users  can  interact  with 
graphic  objects  as  depicted  in  this  environment. 
No  additional  equipment  needs  to  be  worn  by 
participants  and  the  interaction  with  VE  can  be 
via  any  part  of  body,  which  allows  the  user  to 
respond  in  a  relatively  unstructured  and  sponta¬ 
neous  manner. 

The  structured  application  was  applied  using 
the  IREX  platform  Interactive  Rehabilitation  and 
Exercise  (IREX),  a  rehabilitation-oriented  appli¬ 
cation  of  GX.  Since  it  was  developed  to  give  the 
option  to  train  a  specific  movement  (such  as 
shoulder  abduction,  in  order  to  increase  the 
range  of  motion  of  a  specific  joint  or  to  increase 
the  endurance)  prior  to  the  VR  experience,  a 
virtual  model  demonstrates  the  desired  move¬ 
ment  and  again  during  the  virtual  experience 
(see  the  right  panel  of  Figure  1).  Once  the  user 
is  familiar  with  the  required  movement,  he  is 
ready  to  engage  with  the  VE.  During  the  experi¬ 
ence  a  graph  comparing  the  desired  movement 
to  actual  performance  is  located  at  the  bottom 
of  the  screen  in  order  to  encourage  the  user  to 
perform  the  desired  movement.  Since  interac¬ 
tion  should  be  only  with  the  “affected”  arm,  the 


user  wears  a  red  glove  on  one  hand  and  the 
movements  are  performed  in  a  highly  structured 
manner. 

Virtual  Environments 

Two  of  the  virtual  environments  (games)  which 
are  run  on  the  GX  and  IREX  VR  platform,  and 
have  been  described  in  detail  elsewhere10, 
were  used: 

(1)  Birds  &  Balls  -  wherein  the  user  sees  him¬ 
self  standing  in  a  pastoral  setting  where 
balls  of  different  colors  fly  towards  the  user. 
Depending  on  the  intensity  of  contact  by 
any  part  of  the  user’s  body,  the  balls  will 
either  “burst"  or  “transform”  into  doves  and 
fly  away.  Performance  was  rated  by  the 
mean  response  time  (RT)  of  touching  the 
balls  for  the  GX  platform  and  percent  of 
success  for  the  IREX  application. 

(2)  Soccer  -  wherein  the  user  sees  a  video 
reflection  himself  as  the  goalkeeper  in  a 
soccer  game.  Soccer  balls  are  shot  at  him, 
and  his  task  is  to  hit  them  in  order  to  pre¬ 
vent  them  from  entering  the  goal  area. 
Performance  was  rated  by  the  percent  suc¬ 
cess  of  repelling  the  balls  for  both  applica¬ 
tions.  For  these  games,  the  third  minute 
(out  of  a  total  of  4  minutes)  of  each  VR  ex¬ 
perience  was  analyzed,  since  it  should  re¬ 
flect  the  participant’s  best  performance 
(after  participants  had  practiced  but  prior  to 
the  onset  of  fatigue). 


Figure  1:  The  Birds  &  Balls  environments  as  used  within  the  non-structured  (left)  and  structured 
(right)  applications. 
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Outcome  Measures 


PROCEDURE: 


Presence  Questionnaire  (PQ)  (translated  from 
Witmer  &  Singer,  1998)12  was  used  to  assess 
presence.  It  is  composed  of  19  questions  in 
which  participants  use  a  7-point  scale  to  rate 
various  experiences  within  the  VE;  the  maxi¬ 
mum  total  score  is  133  points.  The  items  as¬ 
sessed  different  aspects  of  presence:  involve¬ 
ment/control,  natural,  interface  quality  and 
resolution. 

Scenario  Presence  Questionnaire  (SPQ), 
(based,  in  part,  on  a  translated  version  of  Witmer 
and  Singer's  Presence  Questionnaire12)  was 
administered  after  every  environment.  The  six 
items  assessed  the  participant's  (1)  feeling  of 
enjoyment,  (2)  sense  of  being  in  the  environ¬ 
ment,  (3)  success,  (4)  control,  (5)  perception  of 
the  environment  as  being  realistic  and  (6) 
whether  the  feedback  from  the  computer  was 
understandable.  Responses  to  all  questions 
were  rated  on  a  scale  of  1  -5.  These  questions 
were  combined  to  give  a  global  response  to  the 
experience  for  a  maximum  score  of  30.  This  6- 
item  questionnaire  was  formulated  as  an  abbre¬ 
viated  alternative  to  the  longer  Presence  Ques¬ 
tionnaire. 

Borg’s  Scale  of  Perceived  Exertion 13  was  used 
to  assess  how  much  physical  effort  the  partici¬ 
pant’s  perceived  that  they  expended  during 
each  VR  experience.  This  is  a  20-point  scale 
that  participants  rated  from  6  (no  exertion  at  all) 
to  20  (maximal  exertion). 


Participants  signed  an  informed  consent  and 
then  filled  in  a  demographic  questionnaire. 
They  experienced  both  of  the  games  using  the 
first  application  while  after  each  game  they 
filled  out  the  SPQ  and  rated  their  perceived 
exertion  on  Borg’s  scale  for  the  specific  sce¬ 
nario.  After  completing  the  two  environments 
for  a  given  VR  application,  participants  com¬ 
pleted  the  Presence  Questionnaire.  The  same 
procedure  was  then  done  for  the  second  plat¬ 
form  while  the  order  of  the  platforms  was  coun¬ 
terbalanced. 

DATA  ANALYSIS: 

A  mixed  design,  within  and  between  subjects 
ANOVA  was  used  in  order  to  examine  the  ef¬ 
fect  of  the  type  of  VR  application  (delivered  via 
GX  versus  I  REX)  and  the  user  characteristics 
(i.e.  gender)  as  well  as  the  interaction  between 
these  variables  on  the  sense  of  presence,  per¬ 
formance  and  perceived  exertion. 

RESULTS: 

As  a  first  step  for  analysis  we  examined 
whether  the  order  of  experiencing  the  VR  plat¬ 
forms  influenced  the  results.  There  were  no  sig¬ 
nificant  differences  due  to  the  order  in  which  the 
VR  applications  were  experienced  by  partici¬ 
pants  for  any  of  the  outcome  measures. 


Non-structured  movement 

Structured  movement 

male 

N=14 

female 

ISM  6 

total  population 
N=30 

male 

N=14 

female 

N=16 

total  population 
N=30 

PQ  total  (19-133) 
Involvement/ 
control  (11-77) 
natural  (3-21) 
resolution  (2-14) 
quality  (3-21) 

93.3  +  15 

56.7  +  9.1 

12.4  ±3.5 
7.8  ±2.8 
16,3  ±3.7 

95.6  ±11.4 

60.2  ±7.3 
14.5  ±2.6 
8.8  ±3.1 

12  ±  3.5 

94.6  ±18.4 

58.6  +  8.2 

13.5  ±3.2 

8.4  +  3 

14  ±4.2 

100.3  ±17.3 

59.6  ±10.1 

13.7  ±3.04 

9  ±  3 

18  ±3.2 

92.5  ±19 

53.8  ±11.07 
13  ±4.2 

8.7  ±3.8 

17.1  ±3.1 

96.2  ±18.4 

56.5  ±10.8 

13.3  ±3.6 

8.8  ±3.4 

17.4  ±3.1 

SPQ  (6-30) 

Birds  and  Balls 
Soccer 

24.1  ±2 

21 .3  ±3.4 

26.2  ±2.5 

21 .7  ±5 

25.2  +  2.5 

21 .5  ±4,2 

19.2  ±3.8 

21 .7  ±4.5 

19  ±4.4 

24  ±4.6 

19  ±  4.1 

23  ±46 

Table:  Results  from  the  Presence  Questionnaire  (PQ)  and  the  Scenario  Presence  Questionnaire 
(SPQ)  comparing  participant  responses  when  using  virtual  environments  in  non-structured  and  struc¬ 
tured  paradigms. 
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The  Sense  of  Presence 

No  main  effect  or  interaction  effect  was  found 
for  the  total  PQ,  however  for  three  of  the  four 
subscales  of  the  PQ  interaction  effects  were 
found:  For  the  Involvement/Control  PQ  subscale 
an  interaction  effect  for  application  and  gender 
was  found  (F(28)=6.7,  p=.015),  for  the  Resolu¬ 
tion  subscale  an  interaction  effect  for  application 
and  gender  was  found  (F(28)=4.3,  p=.047)  and 
for  the  Interface  Quality  subscale,  a  main  effect 
for  type  of  application  (F(28)=15.3,  p=.001)  and 
an  interaction  effect  for  application  and  gender 
was  found  (F(28)=4.2,  p=.048).  The  scores  of 
the  total  PQ  and  it's  subscales  for  both  the  non- 
structured  and  structured  movement  applica¬ 
tions  appear  in  the  table. 

Scenario  Presence  Questionnaire 

Birds  and  Balls  -  a  main  effect  for  the  type  of 
application  was  found  (F(28)=45.1,  p=.000). 
Using  the  non-structured  application,  the  partici¬ 
pants  felt  a  significant  higher  sense  of  enjoy¬ 
ment,  control,  realism  versus  the  structured 
mode  while  playing  Birds  and  Balls  (see  Table). 

Soccer  -  No  main  effect  or  interaction  effect 
was  found  for  playing  soccer  using  a  non- 
structured  versus  a  structured  application  (see 
table). 


Performance 

Due  to  technical  difficulties  and  different  out¬ 
come  measures  for  the  Birds  &  Balls  game  on 
the  two  platforms,  comparison  between  the 
movement  constraints  within  the  VE  was  not 
possible.  Therefore,  only  the  percent  of  success 
playing  Soccer  was  compared.  A  significant 
main  effect  for  the  type  of  application  was  found 
(F(28)=159.7,  pc.0001).  Using  the  non- 

structured  movement  the  percent  of  success  of 
stopping  the  balls  of  going  into  the  goal  was 
49.8  ±  9.7  while  the  percent  of  success  for  us¬ 
ing  a  structured  movement  was  92.4  ±  15.8. 
This  difference  was  found  to  be  significant 
(t(29)=1 2.6,  pc.0001).  Performance  during  soc¬ 
cer  for  the  structured  application  may  have 
been  higher  since  bails  are  presented  close  to 
the  user’s  hand;  they  are  not  randomly  distrib¬ 
uted  as  for  the  non-structured  application. 

Perceived  Exertion  (Borg  Scale) 

A  main  effect  for  the  type  of  application  was 
found  for  both  games  (Birds  and  Balls 
(F(28)=12.05,  p=.002),  Soccer,  (F(28)=16.02, 
p=.000))  however  in  the  opposite  direction,  as 
shown  in  Figure  2. 

While  playing  soccer  using  a  structured  applica¬ 
tion,  a  moderate  positive  correlation  was  found 


Figure  2:  Comparison  between  the  perceived  exertion  when  using  virtual  environments  in  non- 
structured  and  structured  paradigms. 
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between  the  percent  of  success  and  the  Sce¬ 
nario  Presence  Questionnaire  (r  =  .46,  p<.05). 
In  other  words,  the  more  the  participant  suc¬ 
ceeded  in  blocking  the  soccer  balls  from  enter¬ 
ing  the  goal  crease,  the  more  he  felt  enjoyment, 
control,  etc.  In  addition,  a  moderate  negative 
correlation  was  found  between  the  perceived 
exertion  while  playing  soccer  with  a  structured 
application  and  Scenario  Presence  Question¬ 
naire  (r  =  -.38,  p<.05)  (i.e.  the  more  the  partici¬ 
pant  felt  enjoyment,  control,  the  less  he  per¬ 
ceived  exertion  while  playing  soccer). 

CONCLUSIONS: 

These  results  support  the  use  of  either  struc¬ 
tured  or  non-structured  movement  in  therapy. 
Selection  of  one  or  the  other  should  depend 
upon  the  therapeutic  goals  for  remediation  of 
neuromuscular  deficit.  Both  movement  options 
used  in  this  study,  structured  and  non- 
structured,  enhance  the  therapist’s  repertoire  of 
VR  intervention  tools  to  maximize  rehabilitation. 
In  addition,  the  results  support  the  influence  of 
user  characteristics  such  as  gender. 

It  is  important  to  note  that,  in  addition  to  the  re¬ 
sults  presented  here,  our  impression  is  that 
there  are  many  subtle  and  not-so-subtle  differ¬ 
ences  between  the  structured  and  the  non- 
structured  movement  paradigms  which  may  be 
relevant  for  therapy.  For  example,  motor  plan¬ 
ning  capabilities  may  only  be  evident  when 
movement  demands  become  more  complex 
(i.e.  when  using  both  the  hands  as  well  as  other 
parts  of  the  body).  This  is  possible  only  via  the 
non-structured  applications  (GX  Platform)  be¬ 
cause  it  encourages  the  user  to  react  to  simulta¬ 
neous,  randomly  distributed  stimuli. 

We  have  also  noted  that  a  more  non-structured 
movement  paradigm  enables  a  therapist  to 
identify  underlying  motor  problems  that  would 
not  be  observed  with  conventional  structured 
treatment  and  assessment.  For  example,  the 
paretic  limb  of  a  patient  who  has  had  a  stroke 
may  be  capable  of  movement  when  activated  in 
isolation  but  become  clumsy  or  slow  when  acti¬ 
vated  with  the  rest  of  the  body.  These  and  other 
issues  will  be  examined  in  future  studies. 

Now  that  a  variety  of  virtual  environments  are 
available  for  use  in  rehabilitation  it  is  imperative 
to  identify  how  variations  in  performance  de¬ 


mands  and  constraints  affect  their  suitability  for 
intervention  of  specific  cognitive  and  motor  defi¬ 
cits.  This  study  is  one  of  the  first  to  address  the 
effect  of  one  important  therapeutic  parameter  % 
spontaneity  versus  rigidity  on  performance  % 
has  on  participant  responses  and  behaviors. 
The  next  step  will  be  to  examine  these  effects  in 
patients  with  motor  and/or  cognitive  deficits.  It 
is  possible  to  provide  users  with  a  satisfactory 
level  of  presence  and  enjoyment  using  both 
structured  and  non-structured  movements.  The 
user  characteristics  such  as  gender  must  be 
taken  into  account  since  it  and  movement  con¬ 
straints  influence  the  user’s  sense  of  presence. 
Further  study  is  needed  to  explore  interactions 
between  performance  and  presence  and  be¬ 
tween  perceived  exertion  and  performance. 
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Abstract:  The  possible  impact  of  VR  on  mental  health  has  the  potential  to  be  even  higher  than  what 
is  currently  offered  by  the  new  communication  technologies  such  as  the  Internet.  In  fact,  VR  is  simul¬ 
taneously  a  technology,  a  communication  interface,  and  an  experience:  a  communication  interface 
based  on  interactive  3D  visualization,  able  to  collect  and  integrate  different  inputs  and  data  sets  in  a 
single  life-like  experience.  However,  significant  efforts  are  still  required  to  move  VR  into  routine  clini¬ 
cal  use:  the  "best"  evidence  in  evaluating  the  efficacy  of  a  therapy/approach  is  the  results  of  random¬ 
ized,  controlled  clinical  trials.  However,  if  we  check  the  available  literature,  the  number  of  published 
trials  is  still  scarce. 

The  main  objective  of  the  European  funded  VEPSY  project  was  to  demonstrate  the  technical  and 
clinical  viability  of  using  Virtual  Reality  Therapy  (VRT)  in  clinical  psychology.  Using  VRT,  it  is  possi¬ 
ble  to  offer  both  exposure  therapy,  the  most  effective  form  of  behavioral  therapy  for  many  conditions, 
and  to  integrate  it  with  other  traditional  psychotherapy  methods  in  order  to  improve  their  effective¬ 
ness.  The  project  was  developed  and  validated  in  different  controlled  clinical  trials  a  well  as  different 
virtual  environments  to  be  used  in  clinical  assessment  and  treatment  of:  social  phobia,  panic  disor¬ 
ders,  male  sexual  disorders,  obesity  and  eating  disorders.  The  controlled  trials  involved  a  total  of  388 
patients,  the  largest-ever  controlled  study  in  VR  therapy. 


1.  INTRODUCTION 

The  possible  impact  of  Virtual  Reality  (VR)  on 
mental  health  could  be  even  higher  than  the 
one  offered  by  the  new  communication  tech¬ 
nologies  like  Internet.  In  fact,  VR  is  at  the  same 
time  a  technology,  a  communication  interface 
and  an  experience1:  a  communication  interface 
based  on  interactive  3D  visualization,  able  to 


collect  and  integrate  different  inputs  and  data 
sets  in  single  real-life-like  experiences. 

Previous  work  has  shown  that  even  relatively 
unsophisticated  Virtual  Reality  tools  can  prove  a 
valuable  tool  in  psycho-neurological  assess¬ 
ment  and  rehabilitation2,3.  To  date,  however,  the 
use  of  VR-technologies  has  been  limited  to  sin¬ 
gle  locations  -  typically  hospital  or  rehabilitation 
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centers.  In  theory,  new  multi-user  VR  technolo¬ 
gies  combined  with  rapid  increases  in  Internet 
bandwidth  and  performance,  as  well  as  steep 
reductions  in  the  cost  of  hardware  and  software, 
making  it  possible  to  bring  distributed  VR  envi¬ 
ronments  directly  to  clients’  homes  -  thereby 
offering  improved  access  for  users  who  are  in¬ 
adequately  served  by  current  services.  In  order 
to  achieve  this  goal,  it  will  first  be  necessary  to 
overcome  a  number  of  clinical,  ergonomic,  tech¬ 
nological,  and  organizational  challenges.  The 
main  contribution  of  the  European  Community 
funded  “Telemedicine  and  Portable  Virtual  Envi¬ 
ronment  for  Clinical  Psychology”  -  VEPSY  UP¬ 
DATED  -  research  project  to  innovation  in  this 
area  is  to  design,  test,  and  validate  solutions  to 
these  challenges4. 

The  main  objective  of  the  project  is  to  prove  the 
technical  and  clinical  viability  of  using  Virtual 
Reality  Therapy  (VRT)  in  clinical  psychology.  In 
particular,  the  project  designed  and  developed 
4  clinical  modules  and  their  associated  clinical 
protocols,  to  be  used  for  the  assessment  and 
treatment  of  the  following  disorders: 

•  panic  disorder  and  agoraphobia 

•  male  impotence  and  premature  ejaculation 

•  obesity,  bulimia  and  binge-eating  disorders 

•  social  phobia 

In  fact,  VR  offers  a  blend  of  attractive  attributes 
for  the  psychologists.  The  most  basic  of  these  is 
its  ability  to  create  a  3D  simulation  of  reality  that 
can  be  explored  by  patients.  VR  can  be 
considered  a  special,  sheltered  setting  where 
patients  can  start  to  explore  and  act  without 
feeling  threatened.  In  this  sense,  the  virtual 
experience  is  an  "empowering  environment" 
that  therapy  provides  for  patients2.  As  noted  by 
Botella  and  colleagues5,  nothing  the  patients 
fear  can  "really"  happen  to  them  in  VR.  With 
such  assurance,  they  can  freely  explore, 
experiment,  feel,  live,  experience  feelings 
and/or  thoughts.  VR  thus  becomes  a  very 
useful  intermediate  step  between  the  therapist 
and  the  real  world. 

This  paper  describes  the  clinical  and  technical 
rationale  behind  the  clinical  applications 
developed  by  the  project.  Specifically  the  paper 
focuses  its  analysis  on  the  possible  role  of  VR 
in  clinical  psychology  and  how  it  can  be  used 
for  improving  therapeutic  change. 


2.  VEPSY  UPDATED:  The  technical  ap¬ 
proach 

To  produce  the  VR  applications  used  in  its  clini¬ 
cal  trials  the  VEPSY  Updated  project  used  PC- 
based  VR  platforms.  The  following  paragraphs 
both  describe  the  rationale  behind  this  choice 
and  detail  the  technical  characteristics  of  the 
VR  platform  chosen  by  the  project. 

2. 1  The  emergence  of  PC  based  virtual  real¬ 
ity 

Even  if  the  history  of  VR  is  based  on  expensive 
graphic  workstations,  the  significant  advances 
in  PC  hardware  that  have  been  made  over  the 
last  three  years  are  allowing  for  low  cost  VR 
systems.  While  the  cost  of  a  basic  desktop  VR 
system  has  not  changed  much,  the  functionality 
has  improved  dramatically,  both  in  terms  of 
graphics,  processing  power  and  VR  hardware 
such  as  head-mounted  displays  (HMDs).  The 
availability  of  powerful  PC  engines  based  on 
Intel's  Pentium  IV,  AMD’s  Athlon  and  Motorola's 
Power  PC  G4,  and  the  emergence  of  reasona¬ 
bly  priced  3D  accelerator  cards  allow  high-end 
PCs  to  process  and  display  3D  simulations  in 
real  time. 

A  standard  Celeron/Duron  2  Ghz  system  with 
as  little  as  1 28  Mb  of  RAM  can  offer  sufficient 
processing  power  for  a  bare-bone  VR  simula¬ 
tion,  a  3.5  Ghz  Pentium  lll//Athlon  with  256  Mb 
of  RAM,  can  provide  a  convincing  virtual  envi¬ 
ronment,  while  a  dual  3.5  Ghz  Pentium  IV 
XEON  configuration  with  OpenGL  acceleration, 
512  Mb  of  RAM  and  128/256  Mb  of  VRAM  run¬ 
ning  on  Windows  XP  Professional,  can  match 
the  horsepower  of  a  graphics  workstation3. 

Immersion  is  also  becoming  more  affordable. 
For  example,  it  is  possible  to  have  a  basic  HMD 
with  gyroscopic  head  tracking  built  in  for  less 
than  $1200.  For  instance,  Olympus  (Japan)  dis¬ 
tributes  its  basic  video  headset  for  about  $600 
without  head  tracking.  Two  years  ago  HMDs  of 
the  same  quality  were  about  10  times  more 
costly.  A  HMD  with  VGA  quality  and  3D  video 
produced  by  a  Korean  manufacturer  is  now 
about  $1 ,500.  However,  this  price  will  probably 
decrease  during  the  next  five  years. 

Presently,  input  devices  for  desktop  VR  are 
largely  mouse  and  joystick-based.  Although 
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these  devices  are  not  suitable  for  all  applica¬ 
tions,  they  can  keep  costs  down  and  avoid  the 
ergonomic  issues  of  some  of  the  up-to-date  I/O 
devices  such  as  3D  mice  and  gloves.  Also,  soft¬ 
ware  has  greatly  improved  over  the  last  three 
years.  It  now  allows  users  to  create  or  import 
3D  objects,  to  apply  behavioral  attributes  such 
as  weight  and  gravity  to  the  objects,  and  to  pro¬ 
gram  the  objects  to  respond  to  the  user  via  vis¬ 
ual  and/or  audio  events. 

2.2  VEPSY  UPDATED:  The  Hardware 

All  the  VR-based  clinical  modules  were  devel¬ 
oped  to  be  used  on  the  following  PC  platforms: 

•  Pentium  IV/Athlon  XP  desktop  VR  system: 

2500  mhz  or  better 
256  mega  RAM  or  better 
minimum  specification  for  the  graphic  en¬ 
gine:  ATI  Radeon  9600  1 28MB  VRam  or 
Nvidia  GeForce  5600  1 28Mb  VRam 

•  Pentium  IV/Athlon  based  portable  VR  sys¬ 
tem: 

1500  mhz  or  better 
1 28  mega  RAM  or  better, 
minimum  specification  for  the  graphic  en¬ 
gine:  ATI  Radeon  9600  32Mb  VRam  or 
Nvidia  GeForce  5600  Go  32Mb  VRam 

The  hardware  also  includes: 

•  A  head  mounted  display  (HMD)  subsystem. 
The  HMDs  used  are: 

1 .  Glasstron  PLM-A35/PLM-S700  from  Sony 
Inc  (http://www.sel.sony.com/SEL7).  The 
Glasstron  uses  LCD  technology  (two  0.7“ 
active  matrix  color  LCD’s)  displaying 
180000  pixels  (PLM-A35:  800H  x  225V) 
or  520000  pixels  (PLM-S700:  832H  x 
624V)  to  each  eye.  Sony  has  designed  its 
Glasstron  so  that  no  optical  adjustment  at 
all  is  needed,  aside  from  tightening  a  two 
ratchet  knobs  to  adjust  for  the  size  of  the 
wearer's  head.  There's  enough  "eye  re¬ 
lief"  (distance  from  the  eye  to  the  nearest 
lens)  that  it's  possible  to  wear  glasses 
under  the  HMD.  The  motion  tracking  is 
provided  by  Intersense  through  its  Inter- 
Trax  30  serial  gyroscopic  tracker 
(Azimuth:  ±180  degrees;  Elevation:  ±80 
degrees,  Refresh  rate:  256Hz,  Latency 
time:  38ms  ±  2). 


2.  VFX-3D  from  Interactive  Imaging  Systems 
Inc  (http://www.iisvr.com).  The  VFX-3D 
uses  LCD  technology  (two  0.7“  active 
matrix  color  LCD’s)  displaying  360000 
pixels  (800H  x  400V)  to  each  eye.  The 
HMD  doesn’t  require  any  optical  adjust¬ 
ment.  It  can  be  easily  worn  using  the  pat¬ 
ented  flip-up  visor.  Included  is  also  an 
accelerometer  based  serial  tracker  (Pitch 
&  Roll  Sensitivity  +/-  70  degrees  +/-  ~0.1 
degrees;  Yaw  Sensitivity  360  degrees  +/- 
0.1  degrees) 

•  A  two-button  joystick-type  input  device  to 
provide  an  easy  way  of  motion:  pressing 
the  upper  button  the  operator  moves  for¬ 
ward,  pressing  the  lower  button  the  opera¬ 
tor  moves  backwards.  The  direction  of  the 
movement  is  given  by  the  rotation  of  opera¬ 
tor's  head. 

To  ensure  the  broadest  user  base,  all  the  VR 
modules  have  been  developed  as  shared  tele¬ 
medicine  tool  available  through  Internet  (see 
paragraph  below)  by  using  a  plug-in  for  the 
most  common  browsers  (Explorer  and  Naviga¬ 
tor)  and  as  portable  tools  based  on  Speed-Step 
notebook  PCs  (Pentium  IV/Duron,  16MB  VRam 
and  256  Mb  Ram).  This  choice  ensures  wide 
availability,  an  open  architecture  and  the  possi¬ 
bility  of  benefiting  from  the  improvements 
planned  for  these  machines  by  INTEL  and 
AMD,  mainly  faster  processors  and  enhanced 
multimedia  support.  Both  solutions  allow  the 
support  of  end-users  in  their  living  environment. 

2.3  VEPSY  UPDATED:  The  Software 

Each  module  was  created  by  using  the  software 
Virtools  Dev.  2.0  (http://www.virtools.com). 
Based  on  a  building-block,  object-oriented  para¬ 
digm,  Virtools  makes  interactive  environments 
and  characters  by  importing  geometry  and  ani¬ 
mation  from  several  animation  packages,  in¬ 
cluding  Discreet  3D  Studio  MAX 
(http://www.discreet.com),  Alias  Wavefront 
Maya  (http://www.aliaswavefront.com),  Soft- 
image  (http://www.softimage.com),  and  Nichi- 
men  Nendo  and  Mirai 
(http://www.nichimen.com),  and  combining 
them  with  an  array  of  more  than  200  basic  be¬ 
haviors.  By  dragging  and  dropping  the  behavior 
blocks  together,  the  user  can  combine  them  to 
create  complex  interactive  behaviors. 
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The  Virtools  toolset  consists  of  Virtools  Crea¬ 
tion,  the  production  package  that  constructs 
interactive  content  using  behavior  blocks;  Vir¬ 
tools  Player,  the  freely  distributable  viewer  that 
allows  anyone  to  see  the  3D  content;  Virtools 
Web  Player,  a  plug-in  version  of  the  regular 
player  for  Netscape  Navigator  and  Microsoft 
Internet  Explorer;  and  the  Virtools  Dev  for  de¬ 
velopers  who  create  custom  behaviors  or  com¬ 
bine  Virtools  with  outside  technology.  Virtools 
Dev  includes  a  full-blown  software  development 
kit  (Virtools  SDK)  for  the  C++  developer  that 
comes  with  code  samples  and  an  ActiveX 
player  which  can  be  used  to  play  Virtools  con¬ 
tent  in  applications  developed  with  tools  such 
as  Frontpage,  Visual  Basic,  or  Visual  C++. 

Content  created  with  Virtools  can  be  targeted  at 
the  stand-alone  Virtools  Player,  at  web  pages 
through  the  Virtools  Web  Player,  at  Macromedia 
Director,  or  at  any  product  that  supports 
ActiveX.  Alternatively,  the  Virtools  SDK  allows 
the  user  to  turn  content  into  stand-alone 
executable  files.  Virtools’s  rendering  engine 
supports  DirectX,  OpenGL,  Glide  and  software 
rendering,  although  hardware  acceleration  is 
recommended. 

3.  VEPSY  UPDATED:  The  clinical  rationale 

Up  to  now,  the  most  common  application  of  VR 
in  clinical  psychology  is  the  treatment  of  pho¬ 
bias.  The  VEPSY  Updated  project  also  ad¬ 
dressed  phobias.  Particularly,  the  Spanish 
group  headed  by  Cristina  Botella  focused  on 
the  treatment  of  panic  disorder  and  agorapho¬ 
bia.  The  French  clinical  group  headed  by  Pat¬ 
rick  Legeron  addressed  the  treatment  of  social 
phobia. 

The  overall  rationale  shared  by  the  two  groups 
is  very  simple:  in  VR  the  patient  is  intentionally 
confronted  with  the  feared  stimuli  while  allowing 
the  anxiety  to  attenuate.  Because  avoiding  a 
dreaded  situation  reinforces  all  phobias,  each 
exposure  to  it  actually  lessens  the  anxiety 
through  the  processes  of  habituation  and  ex¬ 
tinction. 

The  use  of  VR  exposure  (VRE)  offers  a  number 
of  advantages  over  in  vivo  or  imaginal  expo¬ 
sure:  it  can  be  administered  in  traditional  thera¬ 
peutic  settings  and  it  is  more  controllable  and 
cost-effective  than  in  vivo  exposure.  Another 


advantage  of  VR  is  the  possibility  of  carrying 
out  exposure  to  bodily  sensations 
(interoceptive)  and  situational  exposure  simulta¬ 
neously.  Traditionally,  exposure  for  panic  disor¬ 
der  involves  exposure  to  agoraphobic  situations 
and  interoceptive  exposure  that  are  performed 
in  different  sessions.  VR  allows  the  exposure  of 
the  patient  to  an  agoraphobic  situation  (i.e.  a 
train),  and  can  simultaneously  elicit  bodily  sen¬ 
sations  through  visual  or  sound  effects  (blurry 
vision,  pounding  heart,  etc).  In  different  con¬ 
trolled  studies  VRE  was  as  effective  as  in  vivo 
therapy  in  the  treatment  of  acrophobia  6'7,  spi¬ 
der  phobia8,  and  fear  of  flying 91 2. 

The  second  clinical  focus  of  the  VEPSY  Up¬ 
dated  project  was  the  treatment  of  male  sexual 
disturbances.  In  particular,  Optale  and  his 
team13,14  used  immersive  virtual  reality  to  im¬ 
prove  the  efficacy  of  a  psychodynamic  ap¬ 
proach  in  treating  male  erectile  disorders. 

In  the  proposed  VE  four  different  expandable 
pathways  open  up  through  a  forest,  bringing  the 
patients  back  into  their  childhood,  adolescence, 
and  teens  when  they  started  to  experience  feel¬ 
ings  of  attraction.  Different  situations  are  pre¬ 
sented  with  obstacles  that  the  patient  had  to 
overcome  to  continue  on.  VR  environments  in 
this  case  are  used  as  a  form  of  controlled 
“dreams”,  allowing  the  patient  to  express  in  a 
nonverbal  way,  transference  reactions  and  free 
associations  related  to  the  ontogenetic  develop¬ 
ment  of  male  sexual  identity.  General  principles 
of  psychological  dynamisms,  such  as  the  diffi¬ 
culty  with  separations  and  ambivalent  attach¬ 
ments,  are  used  to  inform  interpretive  efforts. 

The  obtained  results  -  30  out  of  36  patients  with 
psychological  erectile  dysfunction  and  28  out  of 
37  patients  with  premature  ejaculation  main¬ 
tained  partial  or  complete  positive  response 
after  6-month  follow-up,  showing  that  VR  seems 
to  hasten  the  healing  process  and  reduce  drop¬ 
outs.  Moreover,  Optale  used  PET  scans  to  ana¬ 
lyze  regional  brain  metabolism  changes  from 
baseline  to  follow-up  in  patients  treated  with 
VR15.  The  analysis  of  the  scans  showed  differ¬ 
ent  metabolic  changes  in  specific  areas  of  the 
brain  connected  with  the  erection  mechanism, 
suggesting  that  this  method  accelerated  the 
healing  process  by  reopening  old  brain  path¬ 
ways  or  consolidating  them.  The  results  also 
suggest  that  new  mnemonic  associations  and 
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rarely-used  inter-synaptic  connections,  charac¬ 
terized  by  a  particular  magnitude  of  activation 
may  be  established,  favoring  satisfaction  of 
natural  drives14. 

The  third  part  of  the  project  focuses  on  obesity 
and  eating  disorders.  Particularly,  Riva  and  his 
clinical  group  led  by  Bacchetta  and  Molinari16,17 
are  using  Experiential  Cognitive  Therapy  (ECT) 
in  an  integrated  approach  ranging  from  cogni¬ 
tive-behavioral  therapy  to  virtual  reality  sessions 
in  the  treatment  of  eating  disorders  and  obesity. 
In  this  approach  VR  is  mainly  used  to  modify 
body  image  perceptions. 

What  is  the  rationale  behind  this  approach?  Dif¬ 
ferent  studies  show  that  body  image  dissatisfac¬ 
tion  can  be  considered  a  form  of  cognitive  bi- 
as18,19.  The  essence  of  this  cognitive  perspec¬ 
tive  is  that  the  central  psychopathological  con¬ 
cerns  of  an  individual  influence  the  manner  in 
which  information  is  processed.  Usually,  this 
biased  information  processing  occurs  automati¬ 
cally.  Also,  it  is  generally  presumed  that  the 
process  occurs  almost  outside  the  person's 
awareness  unless  the  person  consciously  re¬ 
flects  upon  his  or  her  thought  processes  (as  in 
cognitive  therapy). 

According  to  Williamson  and  colleagues18,  body 
size  overestimation  can  be  considered  a  com¬ 
plex  judgment  bias,  strictly  linked  to  attention 
and  memory  biases  for  body  related  informa¬ 
tion:  "If  information  related  to  body  is  selectively 
processed  and  recalled  more  easily,  it  is  appar¬ 
ent  how  the  self-schema  becomes  so  highly 
associated  with  body-related  information...  If  the 
memories  related  to  body  are  also  associated 
with  negative  emotion,  activation  of  negative 
emotion  should  sensitize  the  person  to  body- 
related  stimuli  causing  even  greater  body  size 
overestimation." 

It  is  very  difficult  to  counter  a  cognitive  bias.  In 
fact,  biased  information  processing  occurs  auto¬ 
matically,  and  the  subjects  are  unaware  of  it. 
So,  for  them,  the  biased  information  is  real. 
They  cannot  distinguish  between  perceptions 
and  biased  cognitions.  Moreover,  any  attempt 
for  convincing  them  is  usually  useless  and 
sometimes  produces  a  strong  emotional  de¬ 
fense.  In  fact,  the  denial  of  the  disorder  and  re¬ 
sistance  to  treatment  are  two  of  the  most  vexing 
clinical  problems  in  these  pathologies20,21. 


Given  these  difficulties,  there  are  only  two  dif¬ 
ferent  approaches  to  the  treatment  of  body  im¬ 
age  disturbances19: 

•  cognitive-behavioral  strategies:  This  ap¬ 
proach  is  based  on  assessment,  education, 
exposure  and  modification  of  body  image. 
The  therapy  both  identifies  and  challenges 
appearance  assumptions,  and  modifies 
self-defeating  body  image  behaviors22-24. 

•  feminist  approach:  Feminist’s  therapists 
usually  use  experiential  techniques,  such  as 
guided  imagery,  movement  exercises,  and 
art  and  dance  therapy25,26.  Other  experien¬ 
tial  techniques  include  free-associative  writ¬ 
ing  regarding  a  problematic  body  part, 
stage  performance,  or  psychodrama 26,2 . 

Unfortunately  both  approaches,  even  if  effective 
in  the  long  term,  requires  a  strong  involvement 
of  the  patient  and  many  months  of  treatment. 

The  use  of  VR  offers  two  key  advantages.  First, 
it  is  possible  to  integrate  all  different  methods 
(cognitive,  behavioral  and  experiential)  com¬ 
monly  used  in  the  treatment  of  body  experience 
disturbances  within  a  single  virtual  experience. 
Second,  VR  can  be  used  to  induce  in  the  pa¬ 
tient  a  controlled  sensory  rearrangement  that 
unconsciously  modifies  his/her  bodily  aware¬ 
ness  (body  schema).  When  we  use  a  virtual 
reality  system,  we  feel  our  self-image  projected 
onto  the  image  of  the  visual  cues  (i.e.  a  certain 
figure  or  an  abstract  point,  such  as  cursors, 
which  moves  in  accordance  with  the  movement 
of  our  own  hand)  appearing  in  the  video  moni¬ 
tor,  as  a  part  of  or  an  extension  of  our  own 
hands28.  As  noted  by  Iriki  and  colleagues29, 
“Essential  elements  of  such  an  image  of  our 
own  body  should  be  comprised  of  neural  repre¬ 
sentations  about  the  dimension,  posture  and 
movement  of  the  corresponding  body  parts  in 
relation  to  the  environmental  space.  Thus,  its 
production  requires  integration  of  somatosen¬ 
sory  (intrinsic)  and  visual  (extrinsic)  information 
of  our  own  body  in  space.”  When  this  happens 
the  information  itself  becomes  accessible  at  a 
conscious  level30  and  is  easier  to  modify. 

In  a  case  study,  a  22-year  old  female  university 
student  diagnosed  with  Anorexia  Nervosa  was 
submitted  to  the  ECT  treatment31.  At  the  end  of 
the  in-patient  treatment,  the  subject  increased 
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her  bodily  awareness  joined  to  a  reduction  in 
her  level  of  body  dissatisfaction.  Moreover,  the 
patient  presented  a  high  degree  of  motivation  to 
change.  Expanding  these  results,  they  carried 
different  clinical  trials  on  female  patients32'35:  25 
patients  suffering  from  binge-eating  disorders 
were  in  the  first  study,  20  in  the  second,  and  18 
obese  in  the  third.  At  the  end  of  the  inpatient 
treatments,  the  patients  of  both  samples  had 
significantly  modified  their  bodily  awareness. 
This  modification  was  associated  with  a  reduc¬ 
tion  in  problematic  eating  and  social  behaviors. 

4.  CONCLUSIONS 

How  is  it  possible  to  change  a  patient?  Even  if 
this  question  has  many  possible  answers 
according  to  the  specific  psychotherapeutic 
approach,  generally  change  comes  through  an 
intense  focus  on  a  particular  instance  or 
experience36.  Within  this  general  model  we  have 
the  insight-based  approach  of  psychoanalysis, 
the  schema-reorganization  goals  of  cognitive 
therapy,  the  functional  analysis  of  behavioral 
activation,  the  interpersonal  relationship  focus  of 
the  interpersonal  therapy,  and  the  enhancement 
of  experience  awareness  in  experiential 
therapies. 

What  are  the  differences  between  them?  Ac¬ 
cording  to  Safran  and  Greenberg37,  behind  the 
specific  therapeutic  approach  we  can  find  two 
different  models  of  change:  bottom-up  and  top- 
down.  Bottom-up  processing  begins  with  a  spe¬ 
cific  emotional  experience  and  leads  eventually, 
to  change  at  the  behavioral  and  conceptual 
level,  whereas  top-down  change  usually  in¬ 
volves  exploring  and  challenging  tacit  rules  and 
beliefs  that  guide  the  processing  of  emotional 
experience  and  the  behavioral  planning.  These 
two  models  of  change  are  focused  on  two  differ¬ 
ent  cognitive  systems,  one  for  information  trans¬ 
mission  (top-down)  and  one  for  conscious  ex¬ 
perience  (bottom-up),  both  of  which  may  proc¬ 
ess  sensory  input38.  The  existence  of  two  differ¬ 
ent  cognitive  systems  is  clearly  showed  by  the 
dissociation  between  verbal  knowledge  and 
task  performance:  people  learn  to  control  dy¬ 
namic  systems  without  being  able  to  specify  the 
relations  within  the  system,  and  they  can  some¬ 
times  describe  the  rules  by  which  the  system 
operates  without  being  able  to  put  them  into 
practice. 


Even  if  many  therapeutic  approaches  are  based 
on  just  one  of  the  two  change  models,  a  thera¬ 
pist  usually  requires  both36.  Some  patients 
seem  to  operate  primarily  by  top-down  informa¬ 
tion  processing,  which  may  then  prime  the  way 
for  corrective  emotional  experiences.  For  others 
the  appropriate  access  point  is  the  intensifica¬ 
tion  of  their  emotional  experience  and  their 
awareness  of  both  it  and  related  behaviors.  Fi¬ 
nally,  different  patients  who  initially  engage  the 
therapeutic  work  only  through  top-down  proc¬ 
essing  may  be  able  later  in  therapy  to  make  use 
of  bottom-up  emotional  processing.  In  this  situa¬ 
tion,  a  critical  advantage  can  be  provided  by 
VR. 


VR  can  be  considered  a  sophisticated  commu¬ 
nication  interface39.  Even  if  the  three  applica¬ 
tions  developed  by  the  VEPSY  Updated  project 
have  very  different  rationales,  all  use  VR  as  a 
communication  interface,  able  to  collect  and 
integrate  different  inputs  and  data  sets  in  a  sin¬ 
gle  real-like  experience.  Using  it  accordingly,  it 
is  possible  to  target  a  specific  cognitive  or  emo¬ 
tional  system  without  any  significant  change  in 
the  therapeutic  approach.  For  instance,  behav¬ 
ioral  therapists  may  use  a  VE  for  activating  the 
fear  structure  in  a  phobic  patient  through  con¬ 
frontation  with  the  feared  stimuli;  a  cognitive 
therapist  may  use  VR  situations  to  assess  situ¬ 
ational  memories  or  disrupt  habitual  patterns  of 
selective  attention;  experiential  therapists  may 
use  VR  to  isolate  the  patient  from  the  external 
world  and  help  him/her  in  practicing  the  right 
actions;  psychodynamic  therapists  may  use 
VEs  as  complex  symbolic  systems  for  evoking 
and  releasing  affect. 

In  fact,  one  of  the  main  results  of  the  VEPSY 
Updated  project  was  the  use  of  VR  as  an  ad¬ 
vanced  imaginal  system :  an  experiential  form  of 
imagery  located  between  imagination  and  reali¬ 
ty40*  that  can  be  used  to  help  the  patient  differ¬ 
entiate  between  perception  and  cognition.  As 
noted  by  Glantz  and  colleagues43:  “one  reason 
it  is  so  difficult  to  get  people  to  update  their  as¬ 
sumptions  is  that  change  often  requires  a  prior 
step  -  recognizing  the  distinction  between  an 
assumption  and  a  perception.  Until  revealed  to 
be  fallacious,  assumptions  constitute  the  world; 
they  seem  like  perceptions,  and  as  long  as  they 
do,  they  are  resistant  to  change.”  Using  the 
sense  of  presence  induced  by  VR,  the  therapist 
can  actually  demonstrate  to  the  patient  that 
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what  looks  like  a  perception  doesn't  really  exist. 
Once  this  has  been  understood,  individual  mal¬ 
adaptive  assumptions  can  then  be  challenged 
more  easily. 

Further,  the  project  was  developed  and  vali¬ 
dated  in  different  controlled  clinical  trials  as  well 
as  different  virtual  environments  used  in  the 
clinical  assessment  and  treatment  of:  social 
phobia,  panic  disorders,  male  sexual  disorders, 
obesity,  and  eating  disorders.  The  controlled 
trials  involved  a  total  of  388  patients,  the  larg- 
est-ever  controlled  study  in  VR  therapy  44. 

From  the  scientific  point  of  view,  the  most  im¬ 
portant  project’s  achievement  was  the  success¬ 
ful  integration  of  virtual  reality  therapy  with  tradi¬ 
tional  psychotherapy  approaches,  such  as  cog¬ 
nitive-behavioral  therapy  and  psychodynamic 
therapy.  This  resulted  in  integrated  clinical  pro¬ 
tocols  that  were  tested  in  rigorously  controlled 
clinical  trials.  Results  have  been  published  in 
many  books  and  scientific  journals  such  as 
Clinical  Psychology  and  Psychotherapy,  Behav¬ 
ior  Therapy  and  Experiential  Psychiatry,  Eating 
and  Weight  Disorders,  CyberPsychology  and 
Behavior,  and  MIT’s  Presence.  The  quality  of 
both  the  scientific  and  clinical  work  was  ensured 
by  the  supervision  of  well-recognized  experts 
that  carried  out  peer  evaluations  of  the  work 
done  by  VEPSY  partners  (peer  reviews). 

However,  significant  efforts  are  still  required  to 
move  VR  into  routine  clinical  use.  Clearly  build¬ 
ing  new  and  additional  virtual  environments  - 
possibly  networked  and  integrated  in  portable 
devices  such  as  PDAs  or  cellular  phones  -  is 
important  so  therapists  will  continue  to  investi¬ 
gate  applying  these  tools  in  their  day-to-day 
clinical  practice45.  In  fact,  in  most  circum¬ 
stances,  the  clinical  skills  of  the  therapist  re¬ 
main  the  key  factor  in  the  successful  use  of  VR 
systems. 
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Summary:  The  beginning  of  experimentation  in  telemedicine  in  Italy  dates  back  to  1976,  when  The 
Marconi  Foundation  and  the  University  of  Bologna  developed  the  first  Italian  electrocardiograph  re¬ 
mote  sensing  prototype.  Since  then,  a  number  of  interesting  pilot  projects  have  been  undertaken  in 
the  fields  of  telecardiology,  teleradiology,  telepathology,  home  oxygen  therapy  monitoring,  emer¬ 
gency,  teleoncology  and,  more  recently,  psychotherapy.  In  spite  of  this  rapid  growth  and  a  prolifera¬ 
tion  of  formal  initiatives,  widespread  diffusion  of  telemedicine  services  has  not  occurred. 

To  understand  why,  this  paper  explores  Italian  physicians'  attitudes  towards  the  use  of  telemedicine, 
with  particular  reference  to  medical  teleassistance. 

An  analysis  of  responses  about  perceived  advantages/disadvantages  of  telemedicine  revealed  that 
some  doctors  still  consider  telemedicine  an  approach  of  minor  interest,  well-suited  for  technology 
enthusiasts.  Further,  many  physicians  are  not  convinced  that  telemedicine  can  effectively  improve 
clinical  practice.  These  beliefs  are  deep-rooted  in  doctors  with  higher  seniority,  probably  because 
they  are  more  reluctant  to  accept  the  change  of  well-established  clinical  procedures  (and  also  less 
familiar  with  emerging  technologies  than  their  younger  colleagues). 


To  reduce  such  negative  evaluations,  a  better  circulation  of  information  about  the  state  of  the  art  of 
research  and  development  in  telemedicine  is  needed,  because  this  is  the  prerequisite  to  laying  the 
foundations  fora  more  pervasive  culture  of  telehealth  care  in  Italy. 


1.  INTRODUCTION: 

Telemedicine  means  “medicine  at  distance” 
where  “medicine”  includes  not  only  medical  ac¬ 
tivities  -  involving  ill  patients  -  but  also  public 
health  activities  -  involving  well  people.  In  other 
words,  telemedicine  is  a  process  and  not  a 
technology,  which  involves  many  different 
health  care  activities  carried  out  at  distance1. 
Even  if  most  of  the  telemedicine  trials  are  now 
running  in  the  United  States,  different  studies 
are  carried  on  in  European  countries.  In  particu¬ 
lar,  due  to  the  geographical  particularities  of 
Italy,  this  country  is  considered  a  unique  place 
to  implement  telemedicine  services  on  a  wide 
scale  and  the  situation  is  progressing  rather 
rapidly. 

During  the  1 950's  and  60's  many  individual  ex¬ 
periments  with  medical  services  were  carried 


out  on  the  basis  of  telecommunication.  Often  it 
was  enthusiasts  with  medical  backgrounds  who 
saw  the  possibilities  as  the  teletechnology 
gradually  developed.  We  may  safely  assert  that 
those  experiments  were  mainly  directed  to¬ 
wards  the  technology,  even  if  medical  and  orga¬ 
nizing  matters  were  on  the  agenda.  The  equip¬ 
ment  used  was  poorly  adapted  to  its  purpose. 
The  predicted  cost  was  so  high  that  the  data 
obtained  could  not  be  generalized  to  lead  to 
safe  conclusions. 

Gradually  the  development  of  telemedicine 
moved  towards  solving  concrete  medical  prob¬ 
lems.  In  particular,  the  beginning  of  real  world 
experimentation  with  telemedicine  in  Italy  dates 
back  to  1976,  when  the  Marconi  Foundation 
and  the  University  of  Bologna  developed  the 
first  Italian  electrocardiograph  remote  sensing 
prototype.  In  1990,  the  Ministry  of  Universities, 
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Research  and  Technology  (MURST)  funded  a 
National  Telemedicine  Research  Programme 
with  €50  million  (about  $50  million)  to  foster  the 
implementation  of  telehealth  services  and  to 
estimate  their  practical  costs  and  benefits  for 
the  public  sector,  caregivers,  and  consumers2. 
Since  then,  a  number  of  interesting  pilot  pro¬ 
jects  have  been  undertaken  in  the  fields  of  tele- 
cardiology3,4,  teleradiology5,  telepathology6,7, 
home  oxygen  therapy  monitoring8,  emer¬ 
gency9,10  ,  teleoncology11  and,  more  recently, 
psychotherapy1,12,  to  cite  a  few.  In  spite  of  this 
rapid  growth  and  a  proliferation  of  formal  initia¬ 
tives,  the  widespread  diffusion  of  telemedicine 
services  has  not  occurred  13.  Yet  the  implemen¬ 
tation  of  medical  remote  assistance  would  meet 
concrete  needs.  For  example,  the  rapid  aging  of 
the  Italian  population  implies  an  increasing  need 
for  domiciliary  assistance,  especially  for  patients 
suffering  from  chronic  illnesses14.  Considering 
previous  experiences  and  the  need  for  the  de¬ 
velopment  of  telemedicine  in  Italy,  what  are  the 
barriers  resisting  its  diffusion?  High  costs  and 
technical  limitations  have  been  significantly  re¬ 
duced  and  are  no  longer  a  primary  barrier.  Fur¬ 
thermore,  there  has  been  a  significant  increase 
in  Internet  usage  by  Italian  doctors:  in  June 
2002,  65%  of  them  had  an  Internet  connection, 
compared  with  an  EU  average  of  64%.  How¬ 
ever,  the  number  of  Italian  physicians  who  are 
using  the  Internet  for  clinical  applications  re¬ 
mains  low  (1 6%  compared  with  an  EU  average 
of  27%)15.  According  to  several  authors16,17,  to 
understand  the  reason  of  poor  diffusion  of  tele¬ 
medicine,  more  attention  should  be  paid  to  hu¬ 
man  factors.  Currently,  there  is  little  understand¬ 
ing  of  the  psychosocial  and  cultural  implications 
of  telemedicine  technology.  Indeed,  research  in 
this  field  often  addresses  the  technological  as¬ 
pects  while  neglecting  the  needs,  expectations, 
and  attitudes  of  medical  professionals,  although 
it  is  known  that  acceptance  of  technology  plays 
a  key  role  in  program’s  ultimate  success18.  The 
aim  of  the  present  study  was  to  investigate  the 
attitude  of  an  Italian  sample  of  physicians  to¬ 
wards  telemedicine,  with  particular  reference  to 
medical  teleassistance.  The  survey  took  place 
in  the  Province  of  Milan,  which  represents  the 
biggest  metropolitan  area  in  Italy.  In  this  terri¬ 
tory,  development  of  telemedicine  services  is  in 
an  early  stage15.  The  questionnaire  addressed 
the  following  research  questions: 


•  What  is  the  current  telemedicine  technol¬ 
ogy  knowledge/usage  level? 

•  What  is  the  general  attitude  towards  tele¬ 
medicine  applications? 

•  How  much  money  would  a  medical  profes¬ 
sional  invest  in  a  telemedicine  application? 

•  Which  factors  predict  the  intention  to  use 
telemedicine? 

2.  METHODOLOGY: 

2.1  Questionnaire 

After  a  preliminary  literature  review,  a  focus 
group  that  included  ICT  experts,  physicians, 
and  psychologists  was  carried  out  to  identify 
critical  areas  to  be  covered  by  the  question¬ 
naire.  Then  a  draft  was  designed,  developed, 
and  tested  on  a  small  pilot  sample  to  identify 
misinterpretations  and  reactions  to  the  survey 
instrument.  The  final  questionnaire  had  the  fol¬ 
lowing  structure: 

a.  covering  statements  to  explain  the  research 
project  and  filling  instructions; 

b.  demographic  section  including  items  about 
background  knowledge  of  ICT  systems; 

c.  attitudes  towards  the  use  of  telemedicine; 

d.  perceived  efficacy  of  telemedicine  in  enhanc¬ 
ing  quality  of  care; 

e.  telemedicine  technology  section. 

The  definition  of  telemedicine  used  in  the  ques¬ 
tionnaire  was  “the  use  of  electronic  information 
and  communication  technologies  to  provide  and 
support  health"19.  In  order  to  measure  attitudes 
throughout  the  questionnaire,  respondents  were 
asked  to  indicate  their  level  of  agreement  or 
disagreement  with  a  given  statement  on  a  five 
point  Likert  scale.  To  measure  physicians’  tech¬ 
nology  acceptance,  the  definition  "intention  to 
use"  was  adopted  following  the  approach  sug¬ 
gested  by  Hu  and  colleagues  in  a  similar 
study16.  In  addition,  open-ended  questions, 
closed-ended  questions,  and  questions  requir¬ 
ing  a  yes/no  answer  were  utilized.  Most  closed- 
ended  questions  allowed  the  respondents  to 
add  their  own  additional  response.  The  average 
time  taken  to  complete  the  questionnaire  was 
five  minutes. 
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2.2  Participants 

The  questionnaire  was  sent  to  all  the  physicians 
in  the  Province  of  Milan.  This  area  includes  188 
municipalities  within  the  Lombardy  Region,  with 
a  population  of  almost  four  million  people.  Phy¬ 
sician  and  patient  demographic  data  are  com¬ 
parable  to  national  averages:  on  a  national  level 
the  number  of  physicians  per  1 ,000  inhabitants 
is  2.0;  in  Lombardy  Region  it  is  1 .920.  A  total  of 
2,987  questionnaire  packets  (1,140  to  Milan 
residents  and  1,847  to  hinterland  residents) 
were  delivered  between  December  and  January 
2003  to  the  targeted  physicians,  who  were 
given  four  weeks  to  complete  the  questionnaire. 
A  letter  soliciting  internal  promotion  of  the  study 
accompanied  the  survey.  Physicians  returned 
the  completed  questionnaires  either  via  mail  or 
via  fax. 

3.  RESULTS: 

3.1  Demographic  data  and  background 
knowledge  of  ICT  systems. 

A  total  of  361  doctors  out  of  a  potential  2,950 
responded  to  the  survey  (12%).  Thirty-seven 
questionnaire  packages  (1.2%)  were  lost  be¬ 
cause  of  incorrect  address.  Respondents  aver¬ 
aged  49.4  in  age  (SD  =  7.1)  and  the  majority 
(59%)  had  more  than  20  years  of  clinical  experi¬ 
ence.  Female  respondents  made  up  28.3%. 
66%  of  respondents  were  general  practitioners 
(GP),  25%  were  both  GP  and  specialists,  and 
8.6%  had  only  a  specialist  practice.  Most  sur¬ 
veyed  physicians  worked  for  the  public  health 
system  (76.7%).  A  few  of  them  had  both  private 
and  public  practices  (13.6%)  and  8.3%  had  only 
private  practices.  In  regards  to  background 
knowledge  of  ICT  systems,  67%  of  respondents 
declared  intermediate  informatics  skills  (basic 
knowledge  of  the  operating  system,  knowledge 


Source 

% 

Intermediate 

67.3 

Low 

16.3 

High 

9.1 

None 

6.9 

Missing 

0.3 

Total 

100 

Table  1:  Background  knowledge  of  ITC  sys¬ 
tems 


of  at  least  two  office  applications),  and  6.9% 
reported  no  informatics  skills  (Table  1).  About 
58%  of  respondents  used  to  spend  less  than  1 
hour  a  day  surfing  the  Internet,  17%  answered  1 
to  2  hours  a  day,  only  4%  used  to  surf  more 
than  2  hours  a  day  and  20.8%  never  used  the 
Internet. 

3.2  Knowledge  and  the  use  of  telemedicine 

Results  showed  that  82.5%  of  respondents  had 
already  heard  about  telehealth  care.  No  signifi¬ 
cant  correlation  was  found  between  telemedi¬ 
cine  knowledge  and  demographic  data  such  as 
age  or  gender. 

Table  2  shows  the  principal  media  through 
which  doctors  got  information  about  telemedi¬ 
cine  (more  than  one  option  could  be  selected). 
Specialized  journals  (46%)  and  colleagues 
(41  %)  were  the  principal  sources  of  information, 
followed  by  scientific  meetings  (25.8%),  televi¬ 
sion  (19.1%)  and  the  Internet  (10.2%). 


Source 

% 

journals 

46.0 

colleagues 

41.0 

meetings 

25.8 

television 

19.1 

internet 

10.2 

Table  2:  Information  sources  about  telemedi¬ 
cine  (more  than  one  answer  possible) 

Only  20.5%  respondents,  who  were  informed 
about  telemedicine,  qualified  as  adopters  by 
indicating  previous  or  current  use  of  telemedi¬ 
cine  technology.  The  majority  of  adopters  were 
male  (80.3%)  and  55.7%  of  them  had  had  more 
than  20  years  of  clinical  experience.  77%  of 
adopters  declared  intermediate  informatics  skills 
and  55.7%  of  them  used  to  spend  less  than  1 
hour  a  day  surfing  the  Internet.  About  67%  of 
adopters  worked  for  the  public  health  system, 
21.3%  had  both  private  and  public  practices, 
and  9.8%  had  only  private  practices.  When 
asked  about  frequency  of  use,  most  of  them 
(67.2%)  indicated  that  they  used  telemedicine 
occasionally;  only  27.9%  of  them  reported  a 
weekly  use  of  telemedicine.  Table  3  shows 
which  tools  were  used  by  adopters.  The  most 
cited  tools  were  telemetry  applications  (66.7%) 
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followed  by  e-mail  (21.7%),  Internet  applications 
(18.3%),  videoconference  (6.7%),  and  other 
(4.2%). 


Tools 

% 

Telemetry  applications 

66.7 

E-mail 

21.7 

Internet  applications 

18.3 

Videoconference 

6.7 

other 

4.2 

No  answer 

1.9 

Chat 

0 

Table  3:  Tools  used  by  adopters  (more  than 
one  answer  possible) 


3.3  Perceived  efficacy  of  telemedicine  in  en¬ 
hancing  quality  of  care. 


The  first  question  of  this  section  asked  doctors 
how  much  they  agree  with  the  statement 
“telemedicine  has  the  potential  to  enhance  qual¬ 
ity  of  care”.  The  answers  were  given  on  a  five- 
point  Likert  scale.  Results  showed  that  on  aver¬ 
age  doctors  moderately  agree  with  that  state¬ 
ment  (M=2.94,  SD=0.87). 

Respondents  were  also  asked  to  explain  their 
answers.  Open-ended  responses  were  coded 
by  three  independent  judges.  To  evaluate 
agreement  among  judges,  a  correlation  test  was 
performed  using  Cohen’s  K.  Resulting  values 
were  high,  ranging  from  0.91  to  0.96  for  the  final 
16  categories.  Table  5  shows  the  full  list  of  re¬ 
sponses.  The  most  cited  (12.2%)  positive  state¬ 
ment  was:  “telemedicine  allows  immediacy  for 
intervention  and  diagnosis”,  while  the  most  cited 
(9.4%)  negative  statement  was  “telemedicine 
lacks  face-to-face  contact  between  doctor  and 
patient”. 


Table  4:  Potential  of  telemedicine  to  enhance  quality  of  care  (1  =strongly  disagree  to  5=strongly  agree) 

Cumulative 


Response  Category _ I  %  | _  % 


TM  allows  immediacy  for  intervention  and  diagnosis  12.2  12.2 

TM  lacks  face-to-face  contact  between  doctor  and  patient  9.4  21.6 

TM  improves  continuity  of  assistance  (chronic  patients/monitoring)  8.6  30.2 

TM  allows  saving  of  time,  procedures,  costs,  travel  8.3  38.5 

TM  improves  continuity  of  communication  between  doctor  and  patient  6. 1  44.6 

Not  classified  4.4  49.0 

TM  allows  more  exchange  of  clinical  information  at  a  distance  3.9  52.9 

TM  is  generally  better  than  traditional  approach  3.3  56.2 

TM  provides  advantages  for  elderly  patients  2.8  59.0 

TM  should  not  be  considered  a  replacement  of  traditional  method  of  assistance  2.5  61.5 

Issues  related  to  TM  technology  and  procedures  2.2  63.7 

TM  improves  home-based  assistance  1.9  65.7 

TM  improves  compliance  1.7  67.3 

TM  encourages  exaggerated  conduct  of  patients  (i.e.  alarmism,  hypochondria...)  1.1  68.4 

TM  is  generally  worse  than  traditional  approach  1.1  69.5 

TM  usefulness  is  limited  to  a  low  number  of  cases  1 . 1  70.6 

Missing  _  _  _  _  _  _  29.4  100.0 


Total  100  100.0 


Table  5:  Perceived  advantages/disadvantages  of  telemedicine 
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item/response 

1 

2 

3 

4 

5 

M 

SD 

TM  is  likely  to  reduce  the  number  of  examina¬ 
tions  during  surgery  hours 

12% 

42.1% 

33.5% 

8.6% 

3.0% 

2.5 

0.9 

TM  can  improve  effectiveness  of  therapeutic  in¬ 
tervention 

7.5% 

25.2% 

48.5% 

12.7% 

4.7% 

2.8 

0.9 

TM  can  be  activated  through  easy-to-use  devices 

10.5% 

34.1% 

42.4% 

9.4% 

2.5% 

2.6 

0.9 

Making  good  use  of  TM  is  a  deontological  duty 

2.8% 

8.0% 

38.2% 

31.6% 

17.7% 

3.5 

1.0 

Table  6:  Physicians’  attitude  towards  telemedicine  use  in  medical  practice  (1=strongly  disagree  to 
5=strongly  agree) 


Few  items  focused  on  physicians’  attitude  to¬ 
wards  telemedicine  use  in  medical  practice  (see 
table  6).  Results  showed  that  doctors  are  not 
confident  that  telemedicine  is  likely  to  reduce 
the  number  of  examinations  during  surgery 
hours  (M  =  2.5,  SD  =  0.9).  They  moderately 
agreed  that  telemedicine  has  the  potential  to 
improve  effectiveness  of  therapeutic  interven¬ 
tion  (M  =  2.8,  SD  =  0.9).  Respondents  were  not 
very  optimistic  about  the  possibility  of  imple¬ 
menting  a  telemedicine  system  through  easy-to- 
use  devices  (M  =  2.6,  SD  =  0.9).  However,  most 
doctors  agreed  that  making  good  use  of  tele¬ 
medicine  is  a  deontological  duty  (M  =  3.5,  SD  = 
1.0). 

One  set  of  questions  focused  on  possible  ad¬ 
vantages  telemedicine  could  provide  to  patients. 
Table  7  shows  that  on  average,  doctors  moder¬ 
ately  agree  that  telemedicine  can  overcome  the 
inconvenience  of  going  to  medical  surgery 
(M=2.8,  SD=1)  and  that  telemonitoring  allows 
prompter  intervention  (M  =  3.3,  SD  =  0.9). 


Moreover,  doctors  were  moderately  convinced 
that  telemedicine  provides  psychological  sup¬ 
port  (M=3.0,  SD=1.1)  and  that  it  can  foster  pa¬ 
tient’s  compliance  (M  =  2.9,  SD  =  1). 

Another  critical  issue  addressed  by  the  investi¬ 
gation  was  to  estimate  the  percentage  of  pa¬ 
tients  that  would  be  willing  (and  able)  to  be  in¬ 
volved  in  a  telemedicine  program.  Results  are 
shown  in  Table  8.  According  to  the  large  major¬ 
ity  of  doctors  (about  80%),  less  then  25%  of 
their  patients  would  be  willing  to  try  this  ap¬ 
proach.  Moreover,  about  80%  of  respondents 
estimated  that  less  then  25%  of  their  patients 
would  be  able  to  use  telemedicine  devices. 

To  understand  which  kind  of  devices  physicians 
believe  to  be  more  appropriate  to  implement  a 
medical  teleassistance  service,  respondents 
were  asked  to  give  their  preference  rate  on  a 
five-point  scale  (1  =  not  appropriate;  5  =  very 
appropriate)  to  different  communication  tools 
(see  table  9).  Telephones  were  given  the  high- 


item/response  \ 

i 

2 

3 

4] 

5 

M 

SD 

TM  can  overcome  the  inconvenience  of  going  to 
medical  surgery 

8.6% 

26.6% 

41.8% 

16.3% 

5.5% 

2.8 

1.0 

TM  monitoring  allows  prompt  intervention 

3.3% 

10.5% 

46.5% 

29.6% 

9.4% 

3.3 

0.9 

TM  provides  psychological  support  j 

9.1% 

22.4% 

35.5% 

22.7%  | 

9.4% 

3.0 

1.1 

TM  improves  compliance 

8.0% 

26.0% 

42.7% 

16.6% 

5.3% 

2.9 

1.0 

Table  7:  Perceived  advantages  of  telemedicine  for  patients  (1  =strongly  disagree  to  5=strongly  agree) 


item/response 

0-25% 

25-50% 

50-75% 

75-100% 

How  many  patients  would  be  advantaged  by  tele¬ 
medicine? 

82.6% 

10.8% 

2.5% 

1.6% 

How  many  patients  would  try  telemedicine? 

83.1% 

9.1% 

2.5% 

1.6% 

How  many  patients  would  be  able  to  use  telemedicine 
device? 

79.7% 

11.4% 

4.2% 

0.9% 

Table  8:  Estimation  of  patients’  participation 
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Device 

M 

SD 

Telephone 

3.3 

1.0 

E-mail 

2.4 

1.0 

Videoconference 

2.1 

1.0 

Online  instruments  for  clinical  evaluation  (i.e.  questionnaires) 

2.1 

1.0 

Chat 

1.9 

1.0 

Sms 

1.8 

0.9 

Table  9:  Ratings  of  medical  teleassistance  tools 


est  rating  (M  =  3.3,  SD  =  1),  followed  by:  e-mail 
(M  =  2.4,  SD  =  1);  videoconference  (M  =  2.1, 
SD  =  1.1);  online  instruments  for  clinical  evalua¬ 
tion  (M  =  2.1,  SD  =  1.0);  chat  rooms  (M  =  1.9, 
SD  =  1 .0);  and  sms  (M  =  1 .8,  SD  =  0.9). 

The  last  section  of  the  questionnaire  focused 
specifically  on  respondents’  intention  to  use 
telemedicine  technology.  This  part  included  two 
items.  The  first  question  asked  doctors  whether 
they  would  provide  a  telemedicine  service  if 
they  would  not  have  to  pay  for  the  enabling 
technologies  (and  for  their  maintenance).  The 
second  item  required  participants  to  estimate 
how  much  they  would  eventually  invest  in  a 
telemedicine  system.  About  63%  of  respon¬ 
dents  answered  “yes”  to  the  first  question.  As 
concerns  the  second  question,  about  54%  of 
respondents  indicated  that  they  would  not  per¬ 
sonally  invest  in  a  telemedicine  system;  25% 
would  invest  from  €500  to  €1,000;  18%  would 
invest  from  €1,000  to  €2,000;  and  only  3% 
would  invest  from  €2,000  up  to  €4,000. 


3.4  A  model  of  physician  acceptance  of  tele¬ 
medicine  technology 

A  key  objective  of  this  study  was  to  estimate  a 
model  to  determine  the  factors  which  influence 
intention  to  use  telemedicine  (TM).  The  underly¬ 
ing  hypothesis  is  that  the  intention  to  use  tele¬ 
medicine  for  a  given  individual  can  be  predicted 
on  the  basis  of  selected  variables.  Since  the 
dependent  variable  is  dichotomous  (yes  =  1 ,  no 
=  0),  the  logistic  regression  model  was  used  to 
estimate  factors.  Predictors  considered  by  the 
analysis  were  gender,  seniority,  and  the  follow¬ 
ing  items: 

•  TM  improves  effectiveness  of  therapeutic 
intervention 

•  TM  can  be  implemented  through  easy-to- 
use  devices 

•  It  is  in  accords  with  professional  ethics  to 
make  good  use  of  TM 

•  TM  can  overcome  the  inconvenience  of  go¬ 
ing  to  medical  surgery 


Variable 

B 

S.E.  | 

Wald 

P 

Exp(B) 

Seniority 

-.361 

.165 

4.794 

.029 

1.435 

TM  improves  effectiveness  of  therapeutic  intervention 

.559 

.203 

7.613 

.006 

0.572  : 

It  is  right  to  make  a  good  use  of  TM  for  professional 
ethic 

.397 

.176 

5.080 

.024 

0.672 

TM  can  overcome  the  inconvenience  of  going  to 
medical  surgery 

.346 

.177 

3.817 

.051 

0.707 

TM  improves  compliance 

.449 

.196 

5.257 

.022 

0.638 

Constant 

-2.787 

.999 

i  7.788 

.005 

16.227 

Table  10.  Predictors  of  intention  to  use  telemedicine.  Note:  B  is  the  logistic  regression  coefficient  for 
the  variable;  Exp(b)  is  the  odds  ratio  corresponding  to  a  one  unit  change  in  variable;  The  Wald  statis¬ 
tics  are  distributed  chi-square  with  1  degree  of  freedom. 
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-2  Log  likelihood 

335.964 

.246 

.341 

Table  1 1 :  Logistic  regression:  model  summary.  Note:  Cox  and  Snell  R2  is  a  measure  of  the  fit  of  the 
model,  defined  as  1  -[L(0))/L(BA)]2/N,  where  L(0)  is  the  likelihood  of  the  intercept-only  model,  L(BA)  is 
the  likelihood  of  the  full  model,  and  N  is  the  estimated  population  size.  Nagelkerke  R2  measures  the 
absolute  percentage  of  variation  explained  by  the  model. 


•  Telemonitoring  allows  prompt  intervention 

•  TM  provides  psychological  support 

•  TM  improves  compliance 

•  TM  is  likely  to  reduce  the  number  of  exami¬ 
nations  during  surgery  hours 

To  identify  which  of  these  factors  are  included  in 
the  final  regression  equation,  forward  stepwise 
selection  (Waldesian)  for  logistic  regression  was 
used.  The  results  of  this  analysis  (tables  11-12) 
indicate  that  a  model  including  seniority  and 
responses  to  items:  ‘TM  improves  effectiveness 
of  therapeutic  intervention”;  “making  good  use 
of  TM  is  a  deontological  duty”;  “TM  can  over¬ 
come  the  inconvenience  of  going  to  medical 
surgery”;  “TM  improves  compliance”,  was  statis¬ 
tically  significant  in  predicting  intention  to  use 
telemedicine,  c2  (5,  N  =  337)  =  95.32,  p  =  .001 . 
As  shown  by  the  classification  table  (see  table 
13),  the  model  predicts  79.8%  of  the  responses 
correctly  (90.6%  of  “yes”  and  58.8%  of  “no”);  the 
absolute  percentage  of  variation  explained  by 
the  model  (Nagelkerke  R2)  is  0.34. 

4.  DISCUSSION: 

The  survey  sample  was  made  up  of  361  sponta¬ 
neously  returned  questionnaires.  The  fact  that 
on  average  respondents  were  50  years  old, 
were  well-informed  about  telemedicine  and  had 


20  or  more  years  seniority  suggests  that  doctors 
surveyed  were  in  a  sound  position  to  provide 
feedback  to  the  possible  improvements  that 
telemedicine  may  (or  may  not)  deliver  to  their 
practice. 

About  half  of  the  physicians  moderately  agree 
that  telemedicine  has  the  potential  to  enhance 
quality  of  care.  Immediate  response,  easier  ac¬ 
cessibility,  lower  costs,  and  time  saving  were 
the  main  benefits  noted  by  respondents.  How¬ 
ever,  several  doctors  underlined  potential  short¬ 
comings  of  telemedicine,  emphasizing  in  par¬ 
ticular  the  importance  of  having  face-to-face 
contact  with  patients.  These  observations  sug¬ 
gest  that  although  many  physicians  recognize 
the  advantages  of  telemedicine,  they  also  ques¬ 
tion  the  potential  of  this  technology  to  replace 
traditional  ways  of  diagnosis,  intervention,  or 
treatment.  This  moderately  positive  attitude  is 
reflected  by  the  results  of  Section  II,  which  fo¬ 
cused  on  the  possible  advantages  that  tele¬ 
medicine  could  provide  to  patients.  According  to 
the  majority  of  respondents,  telemedicine  con¬ 
sultation  could  enhance  quality  of  care  by  im¬ 
proving  promptness  of  intervention,  overcoming 
the  inconvenience  of  going  to  medical  surgery, 
providing  psychological  support,  and  fostering 
compliance.  However,  perceived  advantages  for 
patients  and  estimates  of  patients’  participation 


Predicted 

Observed 

Intention  to  use  telemedicine 

Percentage  correct 

YES 

NO 

YES 

202 

21 

90.6 

NO 

47 

67 

58.8 

Overall  Percentage 

79.8 

Table  12:  Logistic  regression:  classification  table 
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were  quite  discouraging:  according  to  the  large 
majority  of  doctors,  less  than  25%  of  their  total 
patient  care  would  be  assisted  by  telemedicine; 
moreover,  respondents  indicated  that  less  then 
25%  of  their  patients  would  want  to  be  involved 
in  a  telemedicine  program.  These  rather  conser¬ 
vative  estimations  can  be  interpreted  in  different 
ways.  First  of  all,  it  is  likely  that  only  a  few  pa¬ 
tients  of  the  doctors  included  in  this  sample 
need  therapy  monitoring  or  frequent  changes  in 
management.  Another  reason  could  be  found  in 
the  doctors’  lack  of  confidence  in  their  patients’ 
ability  to  handle  telemedicine  devices.  Indeed, 
telephones  were  indicated  by  doctors  as  the 
more  appropriate  device  for  telemedicine,  while 
more  sophisticated  and  powerful  communica¬ 
tion  technologies  such  as  the  Internet  and  its 
various  applications  (email,  chat,  videoconfer¬ 
ence,  etc.)  were  given  lower  ratings.  Besides 
usability  aspects,  there  are  further  reasons  that 
may  explain  this  preference.  First,  the  telephone 
is  a  standard  feature  in  most  Italian  homes,  and 
with  the  more  recent  advent  of  mobile  phones 
the  Italian  population  has  even  readier  access 
to  communication  by  telephone.  Moreover,  tele¬ 
phones  have  been  used  on  a  routine  basis  in 
professional  practices  for  a  number  of  decades 
(i.e.  for  giving  and  receiving  referrals,  schedul¬ 
ing  patients,  and  providing  emergency  care), 
while  the  clinical  use  of  the  Internet,  whether 
through  e-mail,  chat  rooms  or  via  audio  or  video 
connection,  is  not  yet  widespread.  As  concerns 
Internet-based  technologies,  results  showed 
that  e-mail  is  considered  the  best  alternative 
communication  tool  for  patients  and  providers, 
although  its  average  score  was  low  (2.4  on  a  5- 
point  Likert  scale).  This  may  reflect  doctors’ 
concerns  regarding  the  technical  and  day-to- 
day  aspects  of  actually  integrating  e-mail  into 
clinical  practices.  These  concerns  are  usually 
related  to  the  potential  for  increased  demand  on 
physician  time  (particularly  with  the  overuse  of 
e-mail  by  patients),  generating  timely  re¬ 
sponses,  inappropriate  or  urgent  content  in  the 
messages,  and  confidentiality  issues21. 

Results  showed  that  63%  of  respondents  would 
accept  telemedicine  if  all  the  devices  were  pro¬ 
vided  for  free.  Moreover,  97%  of  potential 
adopters  indicated  that  they  would  be  willing  to 
invest  less  than  €2,000  in  a  telemedicine  plat¬ 
form.  This  data  indicates  that  cost  reduction  is 
still  a  critical  issue  in  promoting  the  adoption  of 
telemedicine.  As  regards  factors  affecting  inten¬ 


tion  to  use  telemedicine,  the  logistic  regression 
model  (see  Tables  10  and  11)  indicates  that:  (1) 
physicians  with  higher  seniority  are  about  1.5 
times  less  willing  to  use  telemedicine  than  col¬ 
leagues  with  lower  seniority;  (2)  doctors  who 
are  more  confident  about  the  potential  of  tele¬ 
medicine  to  improve  effectiveness  of  therapeu¬ 
tic  intervention  are  more  willing  to  adopt  this 
technology;  (3)  the  more  doctors  believe  that 
making  good  use  of  telemedicine  is  a  deonto- 
logical  duty,  the  higher  their  interest  is  in  using 
this  approach;  (4)  physicians  who  are  more  con¬ 
fident  about  the  potential  of  telemedicine  to  im¬ 
prove  patients’  compliance  are  also  more  willing 
to  adopt  it.  It  is  interesting  to  note  that  with  the 
exception  of  seniority  all  predictors  have  in  com¬ 
mon  the  perceived  advantages  for  patients.  This 
confirms  that  the  propensity  to  use  telemedicine 
is  higher  for  those  professionals  who  are  more 
persuaded  by  the  added  value  of  telemedicine 
in  improving  quality  of  care 16. 

5.  CONCLUSION: 

The  aim  of  this  study  was  to  investigate  physi¬ 
cians'  attitudes  towards  the  use  of  telemedicine. 
As  with  all  pioneering  research  there  are  limita¬ 
tions.  Further  longitudinal  research  is  required 
at  various  levels  and  on  a  national  scale  before 
national/regional  average  comparisons  can  be 
made.  However,  outlining  the  situation  allows  us 
to  draw  from  the  findings  some  rough  guidelines 
and  indications  for  improving  the  situation.  An 
analysis  of  responses  about  perceived  advan¬ 
tages/disadvantages  of  telemedicine  revealed 
that  some  doctors  still  consider  telemedicine  an 
approach  of  minor  interest  which  is  well-suited 
for  technology  enthusiasts.  Further,  many  physi¬ 
cians  are  not  convinced  that  telemedicine  can 
effectively  improve  clinical  practice.  These  be¬ 
liefs  are  deep-rooted  in  doctors  with  higher  sen¬ 
iority,  probably  because  they  are  more  reluctant 
to  accept  the  change  of  well-established  clinical 
procedures  (and  also  less  familiar  with  emerg¬ 
ing  technologies  than  their  younger  colleagues). 
To  reduce  such  negative  evaluations,  a  better 
circulation  of  information  about  the  state  of  the 
research  and  development  in  telemedicine  is 
needed,  because  this  is  the  prerequisite  for  lay¬ 
ing  the  foundations  for  a  more  pervasive  culture 
of  telehealth  care  in  Italy.  This  concerns  issues 
related  to  technology  usage  and  learning,  and 
there  is  a  compelling  need  to  improve  the  us¬ 
ability  of  these  devices22  and  the  set  of  core 
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competencies  and  knowledge  that  are  required 
to  productively  operate  telemedicine  technol¬ 
ogy.  This  could  be  achieved  by  increasing  the 
provision  of  specialistic  training  to  the  operators. 
At  present,  only  one  post-graduate  master  in 
Telemedicine  and  E-Health  is  available  at 
Politecnico  di  Milano  19.  The  outcomes  of  logis¬ 
tic  regression  model  indicate  that  in  order  to 
overcome  physicians’  doubts  towards  telemedi¬ 
cine  it  is  important  to  maintain  the  centrality  of 
the  patient  in  the  evaluation  of  telehealth  pro¬ 
grams.  Rather  then  relying  solely  on  service 
utilization  data,  a  common  practice  in  managed 
care,  the  goal  of  a  patient-centered  evaluation  is 
to  understand  the  human  impact  and  meaning 
of  the  change  in  the  service  patterns  17.  Finally, 
as  recently  indicated  by  the  final  report  of  the 
EU-funded  project  VEPSY  (Virtual  Environ¬ 
ments  and  Telemedicine  in  Clinical  Psychology, 
IST-2000-25323  23),  it  is  necessary  to  develop 
an  appropriate  health  administration  policy  that 
supports  at  both  financial  and  organizational 
levels,  the  implementation  of  telemedicine  ser¬ 
vices.  In  conclusion,  the  results  of  this  study 
confirm  that  attitude  is  an  important  determinant 
of  physician  acceptance  of  telemedicine  and 
emphasize  the  strategic  importance  of  collecting 
psychosocial  information  to  offer  insight  about 
how  to  improve  the  use  of  telehealth  systems. 
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Abstract:  We  describe  the  development  and  early  clinical  testing  of  a  novel  psychiatric  assessment 
tool  that  animates  3D  faces  of  virtual  humans  in  real-time  to  evoke  and  measure  emotional  re¬ 
sponses  of  psychiatric  patients.  The  purpose  of  this  new  tool  is  to  create  a  screening  protocol  where 
repeatable  and  parametric  facial  stimuli  are  presented  interactively  to  patients  in  order  to  character¬ 
ize  and  later  identify  their  respective  mental  disorders  using  their  measured  responses.  The  com¬ 
puter  system,  presented  herein,  uses  photo-realistic  animated  3D  models  of  human  faces  that  dis¬ 
play  basic  emotions,  which  can  be  most  reliably  recognized  from  facial  expressions.  The  patients’ 
ability  to  recognize  these  basic  expressions  (neutral,  happiness,  surprise,  fear,  anger,  disgust  or  sad¬ 
ness)  is  used  as  an  indicator  of  their  mental  health  and  mapped  onto  scientifically  evaluated  symp¬ 
toms  of  the  respective  brain  disorders.  This  paper  presents  our  early  clinical  results  demonstrating 
that  the  new  assessment  tool  can  be  effectively  used  to  screen  patients  for  a  group  of  well-defined 
psychiatric  disorders. 


1.  INTRODUCTION: 

Recognizing  an  emotion  shown  in  a  face  in¬ 
volves  many  different  brain  structures  responsi¬ 
ble  for  both  perceptual  processing  and  the  rec¬ 
ognition  of  facial  components  [1].  Various 
stages  of  emotional  processing  represented 
different  evolutionary  advantages  and  thus  de¬ 
veloped  at  different  times  [2,  3].  This  distributed 
architecture  gives  rise  to  the  possibility  of  study¬ 
ing  various  disorders  of  the  brain  by  the  simple 
means  of  facial  image  animation. 

Clinical  psychologists  have  long  used  facial 
photographs  to  study  their  patients.  As  an  ex¬ 
ample  the  Szondi  Test  [4]  -  which  is  used  to 
detect  psychiatric  disorders  -  is  a  projective 
technique  based  on  a  person's  reaction  to  a 
series  of  48  photographs  of  psychotic  patients. 
The  photographs  were  chosen  in  accordance 
with  the  principle  of  genic  relationship;  that  is, 
the  person  assumedly  selects  a  photograph 
which  portrays  a  psychiatric  disorder  also  inher¬ 
ent  in  the  subject’s  own  familial  genealogy. 
Similarly,  it  is  well  documented  that  Depression 
can  be  detected  as  a  cognitive  bias  in  emotion 
[5,  6].  In  fact,  when  a  depressed  patient  is 
asked  to  select  a  “neutral”  face  from  a  data¬ 


base,  he  or  she  tends  to  choose  faces  that  are 
approximately  1 5%  biased  towards  sad  faces. 

The  diagnosis  of  Alzheimer’s  disease  currently 
"depends  on  clinical  acumen  more  than  objec¬ 
tive  biological  markers”  writes  N.  Relkin  in  [7]. 
Early  research  suggests  that  AD  patients  tend 
to  be  particularly  impaired  in  the  central  execu¬ 
tive  component  of  working  memory  which  ef¬ 
fects  facial  processing  [8].  In  fact  a  possible  ex¬ 
planation  comes  from  MRI  imaging  studies  that 
have  shown  that  the  average  brain  shrinkage  in 
patients  with  AD  has  been  found  to  be  2.5%  per 
year,  compared  to  0.4%  for  age-matched  nor¬ 
mals  [9].  Recently,  strong  evidence  came  from 
a  study  of  22  AD  patients  who  were  significantly 
impaired  on  tasks  of  facial  emotion  matching 
[10].  In  particular,  the  ability  to  recognize  sad¬ 
ness,  surprise  and  disgust  was  more  impaired 
than  recognition  of  happiness,  fear  and  anger. 
The  progression  of  many  other  diseases  related 
to  the  aging  or  the  damage  of  certain  areas  in 
the  brain  can  be  detected  and  qualitatively 
evaluated  through  processing  facial  emotions. 
Subjects  with  Obsessive-compulsive  disorder 
are  impaired  disproportionately  in  the  recogni¬ 
tion  of  disgust  [11].  Some  studies  reported  im¬ 
paired  recognition  of  facial  emotions  in  patients 
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with  Parkinson’s  disease  (although  other  stud¬ 
ies  failed  to  support  that  conclusion)  [12]. 
Strong  evidence  supports  the  disproportionate 
impairment  in  recognizing  disgust  from  facial 
expressions  in  persons  with  Huntington’s  dis¬ 
ease  [13,  14].  Further  examples  include 
Schizophrenia  [15],  Autism  [16]  and  Multiple 
Sclerosis. 

2.  THE  PSYCHO  DISC  DEVICE: 

Recent  advances  in  computer  animated  hu¬ 
mans  [17],  and  in  particular  high  fidelity  facial 
modeling  and  animation  technology,  have  laid 
the  foundation  to  create  novel  clinical  applica¬ 
tions  relying  on  “virtual  patients”  [18]  that  can  be 
digitally  controlled  to  express  subtle  emotions  in 
a  time-varying  manner. 

The  Psycho  Disc  Device  (PDD)  employs  a  cir¬ 
cular  interface  with  the  neutral  position  repre¬ 
sented  in  the  center  and  6-24  3D  examples  of 
the  six  basic  facial  emotions  on  the  periphery. 
The  3D  emotion  examples  are  high  fidelity, 
photo-real  facial  models  that  were  created  using 
a  large  3D  database  of  people.  The  user  may 
navigate  in  this  “emotion  space"  [19,  20]  by 
moving  a  pointing  tool,  such  as  a  mouse,  a 
game  pad  or  joy  stick. 

Doctors  may  use  the  device  to  create  specific 
psychological  tests  to  measure  the  timing  and 
reaction  of  their  patients  to  any  given  sequence 
of  emotional  stimuli,  thereby  allowing  them  to 
diagnose  their  patients’  respective  psychologi¬ 
cal  disorders.  The  PDD  provides  a  unified  plat¬ 
form  for  designing  new  psychiatric  diagnostic 
tests  that  involve  facial  emotion  recognition 
tasks.  These  experiments  may  focus  on  multiple 
aspects  of  the  recognition  process,  including  (i) 
temporal  transition  from  one  expression  to  oth¬ 
ers,  (ii)  the  effect  of  viewing  angle,  (iii)  latency  in 
the  recognition  of  particular  emotions,  (iv)  fa¬ 
mous  &  known  vs.  unknown  people,  (v)  incon¬ 
sistent  emotions,  and  (vi)  static  recognition 
tests,  thus  providing  a  very  detailed  and  refined 
parametric  model  and  description  of  patients 
and  their  respective  disorders. 

A  major  advantage  of  using  the  PDD  is  that  it 
maps  individual  patient  characteristics  onto  a 
well  defined  mathematical  space  in  which  signa¬ 
tures  of  particular  disorders  may  be  recognized 
using  statistical  methods.  It  is  this  output  that 


finally  provides  a  standardized,  parametric  and 
repeatable  data  set  that  can  be  used  by  psy¬ 
chologists  and  researchers  to  finely  map  and 
correlate  a  large  number  of  mental  disorders  to 
the  mental  state  and  early  symptoms,  possibly 
even  before  the  full  onset  of  the  disease  itself. 

3.  EXPERIMENTAL  PROTOCOLS: 

Our  investigation  focused  on  creating  a  medical 
screening  protocol  where  the  repeatable  PDD 
method  and  parametric  facial  stimuli  are  pre¬ 
sented  interactively  to  a  group  of  patients  in  or¬ 
der  to  characterize  and  later  identify  their  re¬ 
spective  mental  disorders  using  their  measured 
responses. 

The  purpose  of  this  investigation  is  to  verify 
theoretical  results  and  gather  evidence  that  dis¬ 
orders,  under  clinical  circumstances,  may  be 
differentiated  solely  based  on  the  degradation  in 
performance  of  recognition  and  the  directions  of 
mistakes  in  recognition  when  compared  to  the 
control  group. 

In  the  experiments  we  used  high  fidelity,  photo 
realistic  digital  replicas  of  a  male  and  a  female 
face  capable  of  expressing  fine  tones  of  neutral 
and  six  basic  emotions  (happiness,  anger,  sad¬ 
ness,  disgust,  fear,  surprise).  Their  circular  ar¬ 
rangement  conformed  to  the  findings  of  describ¬ 
ing  how  transitions  occur  in  emotion  space. 

In  our  preliminary  experiments  we  evaluated  10 
schizophrenic  and  5  depressed  patients  and 
compared  them  with  a  control  group  of  10  nor¬ 
mal  subjects.  All  of  the  non-control  subjects  are 
in  patients,  the  inclusion  criteria  were  as  follows: 

•  all  subjects  were  between  the  ages  of  18 
and  35  years 

•  schizophrenic  patients  included  in  the  ex¬ 
periments  must  have  had  a  positive  BPRS 

•  all  depressed  patients  had  to  have  at  least 
1 5  points  in  Beck  depression  scale 

•  all  controls  had  to  fill  in  the  SCL-90  and  had 
to  have  a  negative  psychiatric  anamnesis 

Before  starting  each  experiment  we  first  had  all 
the  subjects  sign  a  release  statement 
(permission)  and  provide  collected  personal  and 
medical  data  (name,  age,  male,  address,  phone 
number,  qualification,  clinical  diagnosis  (DSM- 
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N(PICTURE  ED) 

Neutral 

Happiness 

Surprise 

Anger 

Disgust 

Fear 

Sadness 

Expressionless 

Joy 

Amazement 

Wrath 

Distaste 

Dread 

Sorrow 

Glassy 

Pleasure 

Astonishment 

Furious 

Loathing 

Awe 

Unhappiness 

Toneless 

Smile 

Revelation 

Spite 

Abomination 

Apprehension 

Gloom 

Pudding-face 

Laugh 

Irate 

Abhorrence 

Dismay 

Tribulation 

Table  1 :  Expression  table  used  in  Experiment  #1 


IV),  medicines  taken,  etc.)  for  later  analysis. 
Each  subject  was  asked  to  carry  out  two  differ¬ 
ent  tests  (see  below)  and  their  performance  was 
measured  on  a  point  scale  to  assess  their  re¬ 
spective  performance. 

•  In  Experiment  #1  we  used  frontal  views  of 
the  two  3D  animated  heads  and  asked  the  sub¬ 
jects  to  identify  emotions  as  they  appeared 
briefly  on  the  screen.  We  recorded  two  separate 
sequences  (7  pictures  each),  one  with  textured 
models  and  the  second  one  without  textures  on 
them  (gray  heads).  We  have  used  a  table  with 
the  names  of  the  basic  emotions  and  their  syno¬ 


nyms.  Patients  were  given  the  following  instruc¬ 
tions:  “We  will  be  showing  pictures  of  faces, 
expressing  different  emotions  on  the  computer 
screen.  Your  task  is  to  choose  and  mark  the 
appropriate  emotion  from  this  table  in  front  of 
you.  Each  table  corresponds  to  one  picture  and 
you  may  mark  only  one  expression  at  a  time. 
Each  column  of  the  table  consists  of  synonyms 
of  one  basic  emotion.  "(See  Table  1  for  details) 

•  In  Experiment  #2  we  created  slowly  varying 
emotional  displays  that  gradually  changed  from 
the  neutral  position  towards  their  respective 
100%  activation  values  in  a  5  second  period. 


Test  2. 


Number  of  Happiness  Surprise  Anger  Disgust  Fear  Sadness  Frame 

the  animation  number 

Frontal  Views 


Table  2:  Expression  table  used  in  Experiment  #2 
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Subjects  were  asked  to  start  and  later  stop  the 
animation  sequence  by  first  pressing  and  re¬ 
leasing  a  button  when  they  recognized  any 
emotion  on  the  digital  face.  Before  starting  the 
experiment,  the  following  specific  instructions 
were  given  to  each  of  them:  “You  are  going  to 
see  an  expressionless  face  on  the  monitor. 
When  you  push  this  button  the  face  will  start 
changing  its  expression  smoothly.  At  some 
point  it  will  begin  to  show  an  emotion.  When  you 
recognize  what  emotion  it  is  you  should  release 
the  button  and  find  it  in  the  table  for  me  to  mark 
it. "  This  experiment  was  carried  out  with  tex¬ 
tured  3D  head  models  in  two  batches  viewing 
them  both  from  frontal  and  %  profile  directions, 
respectively.  (See  Table  2.) 

Finally,  when  both  tests  were  complete,  each 
subject  had  to  fill  out  a  short  questionnaire  to 
record  their  opinions  and  general  feedback  on 
the  tests  themselves.  This  questionnaire  in¬ 
cluded  questions  such  as  “  Was  the  test  boring 
or  exciting,  long  or  short,  etc. " 

4.  RESULTS: 

Tables  3  through  5  show  the  results  of  the  two 
experiments  described  in  the  preceding  section. 
Based  on  statistical  analysis  of  the  data  col¬ 


lected  our  most  important  finding  is  that  even  at 
this  relatively  small  sample  scale  of  the  patient 
population  and  the  control  group  we  have  found 
measurable  difference  in  the  recognition  rate. 
Specifically,  control  persons  had  an  average 
score  of  78.5%,  while  depressed  (p=0.021 ,  de- 
viation=8.22)  and  schizophrenic  persons 
(p=0.062,  deviations  6.92)  had  an  average  of 
70%.  Significance  (p)  values  are  relative  to  con¬ 
trol  group.  (Table  3.) 

We  also  found  significant  difference  in  the  sec¬ 
ond  experiment,  more  precisely  in  the  average 
intensity  levels  of  emotions  when  subjects  rec¬ 
ognized  them.  In  particular,  control  persons  in 
this  experiment  (#2)  had  an  average  score  of 
74%,  while  depressed  patients  (p=0.080,  devia¬ 
tion^!  .27)  scored  80%  and  schizophrenics 
(p=0.01 5,  deviations  1 .92)  scored  84%  on  the 
average.  The  significance  values  (p)  are  relative 
to  control  group.  These  results  are  shown  in 
Table  4. 

Although  the  main  aim  of  the  research  de¬ 
scribed  herein  was  to  find  and  clinically  prove 
that  differences  exist  between  the  control  and 
inpatient  group  when  recognizing  digitally  cre¬ 
ated  basic  emotions,  we  also  had  a  secondary 


Recognition  rate  I.  (mean) 


El  control 
■  schizophrenic 
□  depressed 


OReconiticm 


control 

78,57% 


schizophrenic 

depressed 

70,36% 

70,00% 

Table  3:  Statistical  results  obtained  from  the  static  emotion  identification  experiment  (Exp.  #1). 
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Recognition  II.  (level  of  intensity,  mean) 


w 


control 

schizophrenic 

depressed 

m  Recognition 

70,22 

84,32 

79,83 

Table  4:  Statistical  results  obtained  from  the  dynamic/time-varying  emotion  intensity  recognition  ex¬ 
periment  (Exp.  #2). 


goal:  to  find  out  what  other  aspects  influence 
the  very  process  of  emotion  recognition  itself. 
These  results  are  summarized  in  Table  5.  As  a 
general  conclusion  we  found  the  following: 

•  Expressions  on  the  gray  models  (i.e.  only 
shape  information  without  facial  texture)  are 
more  difficult  to  recognize  than  others. 

•  Recognition  rates  of  particular  expressions 
were  almost  the  same  whether  they  were 
presented  from  a  frontal  or  3A  profile  view. 

•  The  shorter  an  emotion  is  displayed  (Test 
I.),  the  more  difficult  it  becomes  to  recog¬ 
nize  it. 

5.  CONCLUSION: 

In  this  paper  we  described  our  preliminary  clini¬ 
cal  experiments  using  a  novel  method,  called 
Psycho  Disc  Device  or  PDD,  of  diagnosing  psy¬ 
chiatric  disorders.  The  PDD  uses  animated, 
high  fidelity  faces  to  provide  an  objective  and 
parametric  assessment  of  patient  performance. 
Using  a  small  group  of  schizophrenic  and  de¬ 
pressed  patients  as  well  as  a  control  group  of 
healthy  individuals,  we  managed  to  show  statis¬ 


tically  measurable  differences  between  the  re¬ 
spective  population  and  therefore  gather  evi¬ 
dence  that  the  PDD  may  be  used  as  an  efficient 
method  to  screen  patients  for  a  variety  of  psy¬ 
chiatric  diseases.  Our  specific  findings  can  be 
summarized  as  follows: 

•  Evaluation  of  the  data  collected  provided 
evidence  that  Schizophrenic  and  Depressed 
patients  consistently  showed  differentiable 
degradation  in  performance  when  com¬ 
pared  to  the  control  group  on  all  tests  car¬ 
ried  out. 

•  We  examined  two  aspects  of  performance 
(recognition  rate,  and  the  level  of  intensity 
by  recognition).  We  found  significant  differ¬ 
ence  (p  =  0.021)  between  depressed  sub¬ 
jects  and  the  control  group  in  the  first  as¬ 
pect,  and  a  significant  difference  (p  =  0.015) 
between  schizophrenics  and  the  control 
group  in  the  second  aspect. 

Finally,  we  noted  that  significant  performance 
difference  was  recorded  when  using  gray  or 
non-textured  models  vs.  textured  ones. 
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Recognition  rate  at  different  3D  models 


grey, 

frontal 

textured, 

frontal 

textured, 

frontal 

textured, 
%  profile 

Recognition 

53% 

71% 

87% 

85% 

n  grey,  frontal  (test  I.) 

■  textured,  frontal  (test  I.) 

□  textured,  frontal  (test 
II.) 

□  textured,  3A  profile 
(test  II.) 


Table  5:  Comparison  of  recognition  rates  as  a  function  of  3D  facial  model  quality. 


Based  on  the  above,  we  conclude  that  PDD  is  a 
promising  new  way  to  screen  populations  for 
psychiatric  disorders.  In  the  future  we  will  con¬ 
tinue  our  research  by  testing  the  protocol  on  a 
larger  number  of  people  and  by  verifying  the 
results  presented  here.  We  are  also  planning  on 
updating  the  protocol  and  designing  new  experi¬ 
ments  that  may  better  show  the  difference  be¬ 
tween  healthy  and  affected  people.  Finally,  a 
set  of  new  experiments  focusing  on  other  psy¬ 
chiatric  disorders  is  also  in  development. 
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Abstract:  Patients  with  diffuse  or  focal  cerebral  lesions  encounter  cognitive  planning  alteration  that 
interferes  with  social  and  professional  activities.  Standard  cognitive  tests  of  detection  have  some  dif¬ 
ficulties  in  predicting  what  occurs  in  patients’  everyday  life  and  seem  inadequate  in  terms  of  sensitivi¬ 
ty  or  specificity. 

Virtual  Reality  offers  the  capacity  to  assess  patients  in  situations  close  to  their  daily  activities,  thanks  to 
the  safe  and  controlled  progress  of  the  patients  in  a  Virtual  Environment  (VE).  Moreover,  the  introduc¬ 
tion  of  gaming  factors  may  improve  the  motivation  of  subjects. 

We  present  our  approach  in  cognitive  planning  assessment  for  patients  with  Parkinson's  disease.  We 
designed  a  fully  textured  Virtual  Supermarket  (VS)  in  which  the  patient  can  freely  move  behind  a  cart 
and  execute  precise  tasks.  During  a  session,  we  record  all  the  efficient  and  inefficient  actions  of  the 
patient,  her/his  errors  and  her/his  regular  positions  in  the  VS.  We  also  developed  an  analysis  procedure 
of  all  the  recorded  data. 

The  performances  collected  among  six  patients  were  compared  to  those  of  five  healthy  volunteers  in 
order  to  validate  this  approach  and  to  evaluate  its  sensitivity. 

Executive  function  disorders  are  difficult  to  categorize.  Many  studies  emphasize  the  requirement  for 
accurate  cognitive  assessment  and  for  rehabilitation  cognitive  methods  relevant  to  the  patient’s  real 
world.  We  expect  that  the  techniques  of  virtual  reality  should  allow  significant  progress  in  the  predic¬ 
tion  of  action  planning  in  everyday  life.  The  ecological  characteristics  of  our  environment  allow  further 
use  for  behavioral  training. 


1.  INTRODUCTION: 

The  cognitive  disorders  of  neurological  patholo¬ 
gies  constitute  a  major  problem  of  public  health, 
consequently,  the  detection  and  the  rehabilita¬ 
tion  of  these  deficits  must  be  adequate,  and 
occur  as  early  as  possible1.  A  major  criticism 
emitted  against  work  carried  out  to  date  is  that 
the  traditional  cognitive  tasks  are  very  far  away 
from  the  everyday  situations.  These  issues  are 
especially  important  for  neurological  pathologies 
in  which  the  cognitive  alteration  induces  an  im¬ 
portant  social  and  professional  impairment,  like 
Parkinson's  disease  (PD)2,3.  This  degenerative 
pathological  entity  is  characterized  by  an  extra- 
pyramidal  syndrome  combining  akinesia,  rigidi¬ 
ty,  tremor  and  axial  signs.  However,  PD  patients 


frequently  develop  cognitive  dysfunction  even  at 
the  early  stages  of  the  disease4.  This  impair¬ 
ment  predominantly  involves  the  executive  func¬ 
tions,  largely  sustained  by  the  prefrontal  cortex 
and  related  to  deficits  in  control  of  attention, 
planning,  capacity  to  elaborate  a  strategy,  set 
shifting,  and  working  memory5.  Furthermore, 
among  the  cognitive  functions,  planning  is  omni¬ 
present  in  the  everyday  life  and  is  the  most  im¬ 
portant  component  of  cognitive  PD  alteration6. 
This  cognitive  process  is  an  executive  compo¬ 
nent  which  ensures  the  fitting  and  the  space- 
time  scheduling  of  the  various  stages  necessary 
to  a  particular  plan  of  action.  Different  but  com¬ 
plementary  models  were  proposed7'10.  One  of 
the  significant  concepts  introduced  here  with 
regards  to  planning  is  that  of  schemas  of  ac- 
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tion7.  The  schema  corresponds  to  an  elaborate 
cognitive  representation  during  various  sensori¬ 
motor  and  intellectual  experiments  of  the  sub¬ 
ject:  it  is  composed  of  units  of  articulated  cir¬ 
cumstantial  elements.  If  the  articulation  of  these 
units  generally  works  in  a  stereotyped  way,  it 
remains  flexible  and  able  to  adapt  to  the  exter¬ 
nal  constraints.  The  traditional  executive  tasks 
do  not  make  it  possible  to  explore  such 
concepts,  and  they  are  frequently  inefficient  in 
terms  of  sensitivity  or  of  specificity7'8.  These 
tests  in  particular  leave  little  initiative  to  the  sub¬ 
ject.  Some  ecological  paradigms  were  built  to 
rectify  this  situation7,  but  as  they  are  held  in  real 
time  and  in  a  real  environment,  this  considera¬ 
bly  limits  their  use,  especially  for  patients  who 
are  not  physically  autonomous.  The  modeling  of 
planning,  as  presented  above,  and  the  need  for 
the  ecological  character  of  the  tests  contributed 
to  the  emergence  of  new  cognitive  tests,  whose 
scripts  try  to  relate  the  assessment  with  equiva¬ 
lent  daily  life  behavior.  In  fact,  the  test  of  script- 
s8'10  consists  of  a  sequential  and  hierarchical 
organization  of  actions  referring  to  a  particular 
situation  (for  example,  to  go  shopping).  These 
paradigms,  while  placing  the  subject  as  far  as 
possible  in  current  situations,  aim  at  better  un¬ 
derstanding  the  deficits  which  are  expressed  in 
a  specific  way  in  the  daily  activities,  as  well  as  a 
better  apprehension  of  the  complex  interactions 
of  cognitive  disturbances  which  have  occurred 
within  these  activities.  However,  it  is  realized 
that  without  any  production  of  action,  the  sub¬ 
jects  have  to  generate  verbally  what  they  are 
supposed  to  do. 

The  recent  advent  of  virtual  reality  technology 
allows  the  presentation  of  scenarios  or  scripts 
that  are  ecologically  valid  (i.e.  very  close  to  the 
situations  of  life)9, 10.  The  technology  of  the  vir¬ 
tual  environments  has  the  capacity  to  create 
sets  of  3D  dynamic  stimuli,  inside  of  which  all 
the  behavioral  answers  can  be  recorded  and 
measured;  in  addition  the  introduction  of  the 
gaming  factors  into  the  cognitive  evaluation  im¬ 
proves  the  motivation  of  subjects11,12.  It  has 
also  been  shown  that  active  patient  participation 
is  a  key  factor  in  successful  rehabilitation13.  Fi¬ 
nally,  such  an  environment  makes  it  possible  to 
optimize  the  training,  the  generalization  and  the 
transfer  of  acquisitions  towards  the  real  world14. 


2.  PROJECT  GOALS 

Since  we  intend  to  provide  indications  on  the 
cognitive  capacities  in  everyday  life,  it  seems  of 
higher  interest  to  conceive  situations  of  diagno¬ 
sis  which  maintain  the  characteristics  of  the  real 
situations,  while  preserving  criteria  of  standardi¬ 
zation  necessary  to  any  evaluation.  We  propose 
to  evaluate  planning  thanks  to  a  3D  environ¬ 
ment  built  on  the  model  of  scripts  described 
above. 

2. 1  The  tasks  and  the  environment 

We  developed  an  original  paradigm  similar  to 
the  "test  of  shopping  list''1®  in  a  supermarket, 
which  foresees  a  series  of  actions:  concretely, 
the  patient  should  buy  a  certain  number  of  prod¬ 
ucts.  The  search  for  a  particular  object  (for  ex¬ 
ample,  a  cleaning  product)  allowed  the  clini¬ 
cians  to  analyze  the  strategic  choices  made  by 
the  subject  and  thus  the  capacities  of  planning. 

We  wanted  to  analyze  the  visuospatial  as  well 
as  the  temporal  aspects  of  planning.  The  cor¬ 
rect  responses  and  the  errors  were  recorded. 

2.2  Target  population 

This  methodology  was  applied  first  in  a  pilot 
study  on  old,  healthy  subjects  and  patients  suf¬ 
fering  from  PD. 

The  PD  patients  were  referred  by  a  neurologist 
(RMM)  and  selected  from  out-patients  at  the 
Neurology  Department  of  the  University  Hospi¬ 
tal  of  Caen,  France.  They  were  included  in  the 
study  according  to  the  following  inclusion  crite¬ 
ria: 

•  Age  £  80  years; 

•  Ability  to  read  and  write  French,  with  more 
than  five  years  of  education; 

•  Idiopathic  PD,  according  to  the  criteria  of 
Gelb17; 

•  Only  L-DOPA  and  dopamine  agonists  al¬ 
lowed  as  anti-parkinsonian  therapy; 

•  Good  response  to  therapy; 

•  Lack  of  dementia  as  evaluated  by  the  DSM 
IV18; 

•  Hachinski  modified  vascular  score  less  than 
two; 
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•  No  known  history  of  brain  or  thyroid  gland 
disease,  alcoholism,  use  of  psychotropic 
major  agents,  or  depression  as  measured 
by  a  Montgomery  and  Asberg  Depression 
Rating  Scale  score  below  six19. 

The  severity  of  clinical  symptoms  (mild  to  mode¬ 
rate:  stage  1  to  2.5)  were  assessed  on  dopami¬ 
nergic  medication  using  the  Hoehn  and  Yahr 
scale20. 

The  control  subjects  were  included  in  the  study 
according  to  the  following  inclusion  criteria:  Age 
<  80  years;  ability  to  read  and  write  French,  with 
more  than  five  years  of  education;  lack  of  de¬ 
pression  and  dementia  as  evaluated  by  the 
DSM  IV  25;  Hachinski  modified  vascular  score 
less  than  two;  no  known  history  of  brain  or  thy¬ 
roid  gland  disease,  alcoholism,  or  use  of  psy¬ 
chotropic  major  agents,  as  evaluated  using  a 
clinical  examination  and  a  medical  question¬ 
naire. 

2.3  Assessment’s  tools 

The  evaluation  of  global  intellectual  efficiency 
was  carried  out  thanks  to  the  scale  of  Mattis21 
which  explores  through  its  sub-scores  the  fol¬ 
lowing  cognitive  processes:  attention,  initiation, 
capacities  of  conceptualization  and  memory. 

The  classical  exploration  of  the  Executive  Proc¬ 
esses  was  done  with  a  validated  executive  bat¬ 
tery  that  includes  the  Wisconsin  Card  Sorting 
Test22,  the  Brown-Peterson  Modified  Para¬ 
digm23,  the  Stroop  test24,  and  Verbal  Fluency25. 

3.  MATERIALS  AND  METHODS 

3.1  Equipment  and  Software 

The  system  configuration  is  a  Compaq  Minitour, 
Processor  Intel  2.4  GHz,  512  MB  of  RAM,  Video 
card  GE  Force4  MX420  64Mo,  and  a  plug-in  to 
visualize  the  virtual  worlds.  Such  equipment  can 
be  made  available  in  every  hospital 
environment. 

The  virtual  world  images  are  displayed  on  a 
large  screen  monitor.  The  patient  navigates  in 
the  world  either  with  the  keyboard  or  with  a 
Wingman  Logitech  game  pad.  The  patient 
interacts  with  the  artifacts  with  the  mouse  or  the 
game  pad. 


We  used  two  main  software  tools  to  create  the 
3D  virtual  exposure  environment.  We  designed 
the  objects,  the  visual  effects,  and  the  virtual 
worlds  with  Discreet  3D  Studio  Max  4.  The  3D 
design  was  then  integrated  in  a  behavior-based 
interactive  3D  development  tool,  Virtools  Dev, 
which  allows  the  implementation  of  behaviors 
through  scripts. 

The  environments  are  running  on  PC  and  can 
be  viewed  with  the  freely  downloadable  Virtools 
Web  Player  (www.virtoois.comT 

3.2  The  Virtual  Environment 

The  Virtual  Supermarket  (VS)  was  designed  to 
train  action  planning  in  PD.  It  simulates  a  fully 
textured  medium  size  supermarket  with  multiple 
display  stands  for  drinks,  canned  food,  salt 
food,  sweet  food,  cleaning  equipment,  clothes, 
stationery  and  flowers;  refrigerators  for  milk  and 
dairy  products;  freezers;  four  more  specific 
stalls  for  fruits  and  vegetables,  meat,  fishes  and 
bread;  four  cash  desks;  a  reception  point  and  a 
cart  (Figure  1  and  2).  Some  obstacles,  like 
packs  of  bottles  or  cartons  were  designed  to 
hinder  the  advance  of  the  patient  in  the  different 
paths.  They  can  be  removed  if  the  patients  feels 
it  is  too  difficult  to  move  around.  We  introduced 
some  characters  in  the  supermarket  such  as  a 
fishmonger,  a  butcher,  checkout  operators  and 
some  customers. 

The  patient  enters  the  supermarket  behind  the 
cart  and  moves  freely  inside.  Her/his  first  task  is 
to  buy  a  clearly  defined  list  of  products,  to  go  to 
the  cash  desks  and  to  pay.  Other  tasks  could  be 
defined  later. 

We  let  the  patient  experience  the  environments 
from  a  first  person  perspective  without  the 
intermediary  of  an  avatar.  The  patient  is 
represented  by  a  3D  Frame  (a  reference  point) 
bound  to  a  camera  and  to  the  cart.  They  move 
together  because  of  a  hierarchy  link.  The 
collision  tests  between  the  patient  and  the 
objects  of  the  environments  are  managed  by 
the  cart,  which  is  also  bound  to  be  on  floor. 

The  patient  navigates  in  the  virtual  supermarket 
using  the  cursor  movement  keys  or  a  Wingman 
Logitech  game  pad.  These  devices  allow  tran¬ 
slation  and  rotation  movements. 
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Figure  1 :  Supermarket  front  view 


The  patient  is  free  to  pick  up  products  by  pres¬ 
sing  the  left  mouse  button.  If  they  appear  in  the 
list  defined  by  the  therapist,  they  are  moved  to 
the  cart.  At  the  cash  desk,  the  patients  can  put 
the  products  on  the  conveyor  belt  and  put  them 


back  in  the  cart  by  pressing  the  left  mouse  but¬ 
ton  on  the  belt.  Finally,  by  clicking  on  the  purse, 
the  patient  can  pay  and  go  to  the  supermarket’s 
exit. 


3.3  Session’s  unfolding 


We  also  measured  and  recorded  the  duration  of 
the  session  and  the  trajectory  of  the  patients. 


During  two  preliminary  training  sessions,  the 
patient  learns  to  move  in  the  virtual  supermar¬ 
ket,  to  recognize  the  various  places  and  to  pick 
up  objects  which  are  different  from  those  on  the 
therapist’s  list. 

Then  the  patient  enters  the  supermarket  for  a 
cognitive  planning  evaluation.  Her/his  task  is  to 
buy  a  clearly  defined  list  of  products,  to  go  to 
the  cash  desks,  and  pay.  The  instructions  rela¬ 
ted  to  the  task  are,  at  first,  written  on  the  screen 
and  the  defined  products  are  shown  in  the  right 
part  of  the  screen.  As  the  patient  progresses 
with  her/his  purchases,  the  products  appear  in 
the  cart  and  disappear  from  the  screen.  The 
instructions  related  to  cash  desk  area  are  verbal 
and  given  before  the  beginning  of  the  session. 

3.4  Recording  and  measurement 

For  the  purpose  of  further  analysis,  the  system 
records  and  measures  various  parameters  while 
the  patient  experiences  the  virtual  environment.  All 
the  patient  actions  are  recorded.  If  the  patient 
chooses  goods  that  are  not  in  the  list,  her/his  ac¬ 
tion  is  recorded  as  a  mistake.  The  patient  can 
leave  the  supermarket  without  buying  anything, 
without  paying.  The  patient  can  also  stay  in  the 
supermarket.  All  these  situations  are  recorded. 


4.  RESULTS 

Our  preliminary  study  compared  six  PD  patients 
(2  females,  4  males)  to  five  control  subjects  (4 
females,  1  male).  All  the  subjects  were  included 
according  to  the  respected  inclusion  criteria  pre¬ 
viously  defined  in  this  paper.  The  mean  age  of 
each  group  was  74.0  years  (SD  =  5.4)  for  PD 
patients  and  66.6  years  (SD  =  7.7)  for  control 
subjects.  Mattis  mean  score  was  136.4  (SD  = 
6.6)  for  PD  patients  and  139.8  (SD  =  4.1)  for 
controls,  which  is  consistent  with  a  preserved 
global  intellectual  function  of  our  patients.  All 
the  recorded  data  (means  and  standard  devia¬ 
tions)  are  shown  in  Table  1 .  Interestingly,  all  the 
patients’  performances  are  lower  than  the  con¬ 
trols  data. 

On  this  small  group,  only  the  covered  distance 
and  the  duration  of  the  test  are  significantly  al¬ 
tered.  The  trajectory,  shown  in  the  Figures  3  and 
4,  demonstrates  that  numerous  stops  and  turning 
around  the  same  shelves  seems  to  be  character¬ 
istic  of  the  PD  patients. 


PD  Patients 

N=  6  (2  F,  4  M) 

Controls 

N=  5  (4  F,  1  M) 

Age 

74.0  ±  5.4 

66.6  ±  7.7 

Mattis  Scale 

136.4  ±6.6 

139.8  ±4.1 

Distance  (m) 

343.1  ±113.9* 

224.8  ±  36.4 

Duration  (min) 

20.4  ±  8.2  * 

10.4  ±  1.3 

Stops  Number 

56.6  ±  32.9 

25.4  ±  3.5 

Mean  Stop  Duration  (sec) 

13.4  ±2.3 

12.3  ±2.3 

Time  to  Pay  (sec) 

1 4.6  ±  12.8 

j  5.7  ±8.1 

Good  Actions 

11.6  ±  1.5 

12.0  ±0.0 

Intrusions 

3.6  ±3.3 

2.0  ±  0.7 

Table  1 :  Means  and  standard  deviations  of  the  recorded  data 


* :  p  <  0.05,  significant  difference  between  the  two  groups,  using  the  non  parametric  Mann-Whitney  test. 
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5.  DISCUSSION  solve  problems  as  compared  to  controls,  but 

show  slowness  in  the  initial  thinking  time  (time 
A  specific  alteration  of  executive  function  is  a  between  the  presentation  of  the  problem  and 

well-known  trait  of  PD4,26.  However,  planning  the  first  movement).  The  authors  interpreted 

deficit,  although  often  reported  in  PD  (using  the  these  results  as  a  difficulty  to  elaborate  an  ac- 

tests  of  Towers,  for  example),  was  not  perfectly  tion  plan,  a  deficit  which  essentially  concerns 

clarified  as  the  mechanism  (i.e.  alteration  of  the  anticipation  of  the  optimal  solution.  Taylor  et 

planning  latency  or  accuracy  and  of  shifting  al  suggested  that  the  principal  cognitive  deficits 

processes).  The  tower  of  London,  developed  by  in  patients  with  PD  occurs  in  tasks  involving 

Shallice  to  assess  planning  capacities,  is  a  “self-directed  behavioral  planning,”  although  in  a 

paradigm  in  which  the  subject  must  move  col-  later  study  involving  patients  with  mild  PD  no 

ored  balls  to  match  a  specific  arrangement  in  deficits  were  found  using  a  three  disk  planning 

the  minimum  number  of  moves  possible.  Using  problem  solving  similar  in  design  to  the  Tower 

this  task,  Morris  showed  that  PD  patients  do  not  of  London  test.  The  fact  that  patients  with  mild 

make  more  moves  than  those  required  to  re-  PD  were  not  impaired  in  terms  of  accuracy  of 


Figure  4:  Trajectory  of  a  PD  Patient 
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solutions  contrasts  with  the  severe  impairment 
observed  in  these  patients  on  other  “frontal 
lobe”  tests,  and  may  suggest  that  planning  defi¬ 
cits  remain  undetected  if  the  task  employed  is 
insufficiently  challenging  for  these  patients34. 
These  results  underline  the  usefulness  and  the 
difficulties  of  an  adequate  evaluation  of  plan¬ 
ning. 

Our  data  suggests  partially  altered  planning 
functions  and  provides  further  understanding 
concerning  the  mechanism  of  this  deficit.  The 
absence  of  significant  difference  with  regard  to 
control  subjects  for  the  number  of  correct  ac¬ 
tions  suggests  that  global  access  to  the  seman¬ 
tic  knowledge  of  the  script  is  normal  in  PD. 
However,  in  our  study,  the  introduction  of  spe¬ 
cific  measures  such  as,  distance,  duration, 
number  of  stops  (see  Table  1)  as  well  as  the 
trajectory  record  allow  us  to  precisely  identify 
the  planning  alteration  in  PD.  Godbout  et.  al. 
tried  to  precisely  identify  these  mechanisms 
using  a  script  generation  test.  It  was  found  that 
the  patients  with  PD  generate  less  sub-orderly 
actions,  "minor  actions,"  than  super-orderly  ac¬ 
tions,  "major  actions";  the  patients  would  have 
difficulties  recalling  contextual  elements  and 
consequently  their  representations  of  routine 
activities  would  not  be  as  rich  and  detailed  as 
those  of  controls.  Such  difficulties  could  reflect  a 
SAS  (Supervisory  Attentional  System)  deficit8 
which  modulates  cognitive  operations.  The  in¬ 
creased  distance  and  duration,  as  well  as  the 
inefficient  trajectory  (see  Figure  4)  observed  in 
our  PD  group,  are  consistent  with  a  slowness  of 
information  treatment  and  with  the  insufficient 
use  of  contextual  elements40.  These  results  un¬ 
derline  spatial  and  temporal  aspects  of  the  plan¬ 
ning  deficits  in  PD.  The  trajectory  utilized  by  the 
patients  could  also  suggest  a  dysfunction  in  the 
switching  mechanism  necessary  to  treat  in  par¬ 
allel  several  items  of  information.  Our  future 
analyses  using  correlations  with  classical  ex¬ 
ecutive  tests  could  help  to  interpret  our  results. 

From  a  more  general  point  of  view  this  kind  of 
VE  seems  to  be  a  useful  tool  for  planning 
evaluation  and  rehabilitation.  Several  teams 
have  already  underlined  the  advantages  of  this 
technique,  in  particular  its  ability  to  evaluate  the 
executive  functions  and  attention  properties'36. 
One  of  the  specific  interests  of  our  VE,  compa¬ 
red  with  previous  studies,  is  the  strict  similarity 
to  the  real  word.  In  fact,  we  took  into  account 


the  real  dimensions  of  a  supermarket,  we  repro¬ 
duced  the  various  shelves,  and  unlike  other  stu¬ 
dies,  the  subjects  can  move  freely  in  the  super¬ 
market.  Finally,  our  principal  target  population, 
PD,  is  characterized  by  a  dysfunction  in  motor 
symptoms,  and  VR  describes  the  alterations  of 
planning  by  utilizing  a  non-clinical  point  of  view, 
by  testing  "pure"  mental  sequences  without  the 
interference  of  motor  disability. 

6.  CONCLUSION 

In  accordance  with  our  experience  in  action 
planning,  and  our  dissatisfaction  with  the  cur¬ 
rent  tools  of  evaluation,  we  decided  to  design  a 
3D-supermarket  to  assess  action  planning  for 
patients  suffering  from  PD.  As  with  many  appli¬ 
cations  in  behavioral  neuroscience,  we  desi¬ 
gned  a  controlled  environment  that  is  as  life-like 
as  possible.  We  defined  the  requirements,  the 
patient  tasks  and  the  assessment  tools.  Our 
data  suggests  a  slowing  down  of  planning  pro¬ 
cesses  in  PD  as  well  as  an  inefficient  use  of 
contextual  elements;  however,  these  results 
must  be  confirmed  on  a  larger  group.  Further¬ 
more,  the  criteria  of  success  will  be  constituted 
by  the  following  additional  points:  the  facilitated 
use  by  the  subjects  and  the  adaptability  of  the 
software,  sensibility  superior  to  that  of  the  usual 
cognitive  tools,  improvement  of  the  cognitive 
deficits  after  training. 
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Abstract:  Joint  disease  is  a  significant  health  issue  for  a  large  portion  of  the  general  population  and 
an  even  greater  issue  for  the  elderly.  Pain  associated  with  joint  disease  can  be  treated  with  pharma¬ 
cological  and  non-pharmacological  therapies.  Currently,  there  are  no  pharmacological  agents  that 
are  able  to  simultaneously  provide  relief  from  the  pain,  improve  quality  of  life,  and  not  risk  adverse 
side  effects. 

The  specific  aim  of  this  project  is  to  develop  a  non-pharmacological  treatment  option  for  chronic  joint 
pain.  We  are  working  to  achieve  this  aim  by  developing  a  system  that  combines  virtual  reality  tech¬ 
nology  with  hardware  for  physical  therapy.  Physical  therapy  (PT)  has  been  shown  to  be  an  effective 
treatment  for  chronic  joint  pain,  resulting  in  increased  range-of-motion  (ROM),  greater  strength,  less 
dependence  on  pharmacological  treatments,  and  improved  quality  of  life.  Virtual  reality  (VR)  has 
been  shown  to  distract  patients  from  pain  during  treatment  and  therapy.  By  combining  VR  with  a  PT 
system,  we  expect  to  achieve  more  effective  treatments  with  less  discomfort  in  patients  suffering 
from  chronic  joint  pain. 

The  results  of  our  pilot  study  affirmatively  confirmed  our  hypotheses.  Of  the  eight  subjects  with  adhe¬ 
sive  capsulitis  tested,  all  of  those  that  were  immersed  in  the  virtual  reality  system  were  distracted 
from  pain  associated  with  the  therapy.  Of  all  of  the  test  subjects,  87.5%  preferred  using  the  VR- 
enhanced  system  and  would  have  chosen  to  continue  using  the  VR-enhanced  system  (if  that  were 
possible)  in  their  continued  physical  therapy  treatments. 


1.  INTRODUCTION 

1.1  Joint  Pain  is  a  Significant  Health  Issue 

Joint  pain  is  a  leading  cause  of  disability  and,  as 
our  population  ages,  it  will  increasingly  affect 
larger  numbers  of  individuals  and  our  national 
economy.  Aging  gradually  reduces  the  physiol¬ 
ogic  reserve  that  is  available  to  perform  daily 
activities.  When  the  physical  impairments  and 
chronic  pain  associated  with  joint  pain  (such  as 
arthritis  or  adhesive  capsulitis)  are  combined 
with  age-related  changes,  physiologic  reserve  is 
further  compromised,  which  increases  the  risk 
of  functional  dependency  and  greater  economic 
losses.  Patients  with  joint  disease  commonly 
first  consult  a  physician  because  of  pain. 


Adhesive  capsulitis  (AC)  affects  approximately 
two  percent  of  the  general  population.  It  is  char¬ 
acterized  by  the  loss  of  shoulder  motion.  Pri¬ 
mary  adhesive  capsulitis  is  characterized  by 
idiopathic,  progressive,  and  the  painful  loss  of 
shoulder  motion.  The  onset  of  pain  causes 
many  patients  to  limit  the  use  of  the  arm.  Due  to 
the  loss  of  motion,  patients  can  gradually  find  it 
increasingly  difficult  to  perform  everyday  activi¬ 
ties.  AC  patients  also  tend  to  develop  pain  com¬ 
pensating  movements  which,  over  time,  result  in 
less  shoulder  pain  but  with  the  side  effects  of  a 
stiff  shoulder  and  a  significant  limitation  of  func¬ 
tion. 

The  root  cause  of  AC  is  still  not  fully  under¬ 
stood;  however,  there  are  two  primary  explana¬ 
tions  for  the  underlying  pathophysiology  of  the 
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disease.  There  is  disagreement  as  to  whether 
the  underlying  pathologic  process  is  an  inflam¬ 
matory  or  fibrosing  condition.  There  is  signifi¬ 
cant  evidence  that  the  underlying  pathologic 
changes  are  due  to  synovial  inflammation  and 
subsequent  reactive  capsular  fibrosis.  However, 
the  initial  trigger  of  inflammation  and  fibrosis  is 
still  unknown  for  most  patients. 

1.2  Pharmacological  Treatments  for  Joint 
Pain 

The  primary  goals  of  treating  patients  with  joint 
pain  are:  pain  management,  minimizing  disabil¬ 
ity,  improving  quality  of  life,  and  preventing  pro¬ 
gression  of  the  disease.  Of  these  goals,  the 
most  important  is  pain  control,  because  pain 
has  strong  associations  with  disability  and  qual¬ 
ity  of  life.  Furthermore,  since  there  are  no 
causative  treatments  for  joint  pain,  all  therapeu¬ 
tic  measures  in  joint  pain  treatment  are  de¬ 
signed  to  treat  symptoms  of  the  diseases 
(i.e.  managing  the  pain). 

The  use  of  drugs  for  the  treatment  of  pain  asso¬ 
ciated  with  joint  disease  has  significant  draw¬ 
backs.  For  example:  analgesics  can  cause 
strong  adverse  reactions  and  dependency;4 
NSAIDs  introduce  significant  gastrointestinal 
and  renal  toxicity;  corticosteroids  can  cause 
cataracts,  a  vascular  necrosis  of  bone,  osteopo¬ 
rosis,  thin  skin,  and  muscle  fiber  atrophy;  and 
immunosuppressive  drugs  may  result  in  respira¬ 
tory  compromise,  weakness,  cognitive  deficit, 
fatigue,  sexual  problems,  and  impaired  bal¬ 
ance.7  Clearly,  there  is  no  single  drug  that  is 
both  completely  effective  and  safe  in  treating 
joint  pain.  Further,  the  significant  risks  from  pro¬ 
longed  drug  use  have  required  the  development 
of  non-pharmacological  treatments  for  joint 
pain. 

1.3  Non-Pharmacological  Treatments  for 
Joint  Pain 

Significant  effort  has  been  expended  in  the  de¬ 
velopment  of  non-pharmacological  joint  pain 
treatments.  These  include:  heat,  cold,  electrical 
stimulation,  light  therapy,  splints  and  orthoses, 
diet,  weight  loss,  psychology,  and  exercise.  Of 
all  of  the  non-pharmacological  pain  treatments 
for  joint  pain,  exercise  has  been  one  of  the  most 
rigorously  studied  and  shown  to  have  significant 
beneficial  effects  for  the  disease.  The  proven 


benefits  include:  increases  in  strength,  range-of- 
motion  (ROM),  aerobic  capacity;  and  decreases 
in  disease  activity  and  pain  level.7 

In  AC,  a  supervised  physical  therapy  program 
has  been  used  effectively  in  many  patients. 
Physical  therapy  is  preferred  because  a  major 
objective  in  treating  AC  patients  is  to  restore 
function  by  decreasing  the  inflammation  and 
pain,  increasing  ROM,  and  reestablishing  nor¬ 
mal  shoulder  mechanics.  Research  has  shown 
that  there  are  significant  long-term  benefits  to 
physical  therapy  for  AC  patients.  It  has  been 
observed  that  passive  ROM  increased  signifi¬ 
cantly  for  flexion,  abduction,  and  internal  and 
external  rotation  of  the  shoulder.  The  physical 
therapy  also  resulted  in  significant  decreases  in 
perceived  pain  between  initial  and  final  evalua¬ 
tions.  A  recent  study  showed  the  benefits  of 
using  anesthesia  during  physical  therapy  treat¬ 
ments  for  AC.  The  anesthesia  enabled  the  pa¬ 
tients  to  be  distracted  from  the  pain  during  ther¬ 
apy  and  enabled  the  anesthesized  group  to 
achieve  greater  benefits  in  shorter  periods  of 
time  as  compared  to  the  group  receiving  the 
same  physical  therapy,  except  without  anesthe¬ 
sia. 

1.4  Virtual  Reality  Has  Been  Shown  to 
Reduce  Perceived  Pain  During  Therapy 

It  has  been  recognized  for  some  time  now  that 
virtual  reality  (VR)  has  the  potential  to  be  used 
to  improve  the  quality  of  life  in  the  real  world. 
Applications  include  treatment  of  phobias,  eat¬ 
ing  disorders,  post  traumatic  stress,  and  pain 
management.  VR  allows  individuals  to  become 
active  participants  in  a  computer-generated 
world  that  changes  in  a  natural  way  (i.e.  as  our 
past  physical  experience  would  suggest)  and 
responds  to  the  individual’s  motion. 

One  example  of  this  has  been  a  system  devel¬ 
oped  to  distract  burn  patients  from  pain  during 
wound  care.  The  system  that  was  developed  in 
these  studies  consisted  of  a  virtual  kitchen 
where  patients  could  open  drawers,  pick  up 
pots,  touch  other  objects,  and  see  three- 
dimensional  images.  In  both  reports,  the  conclu¬ 
sion  is  that  VR  can  function  as  an  effective  non- 
pharmacological  method  for  reducing  perceived 
pain  during  wound  care  and  during  physical 
therapy. 
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Based  on  the  evidence  in  the  open  literature 
discussed  above:  (1)  joint  pain  is  a  significant 
health  care  issue;  (2)  an  effective  nonpharma- 
cological  treatment  for  many  of  the  symptoms  of 
joint  pain  from  a  number  of  diseases  is  physical 
therapy;  and  (3)  VR  can  be  used  to  distract  pa¬ 
tients  during  painful  therapy,  Creare  is  develop¬ 
ing  a  VR  system  for  physical  therapy  that  can 
be  used  to  treat  joint  pain. 

2.0  MATERIALS  AND  METHODS 

2.1  System  Overview 

Figure  1  shows  a  picture  of  Creare’s  Virtual  Re¬ 
ality-Enhanced  Physical  Therapy  System.  Our 
system  combines  an  immersive  VR  system  with 
physical  therapy  hardware.  The  system  is  de¬ 
signed  to  enable  patients  with  joint  pain  to  un¬ 


dergo  rigorous  physical  therapy  treatments 
while  being  distracted  by  VR  technology  from 
pain  that  may  be  induced  by  the  therapy.  Our 
overall  system  consists  of  the  following  compo¬ 
nents: 

Haotic  Interface.  The  haptic  interface  is  used  to 
both  perform  physical  therapy  on  patients 
and  to  provide  realistic  force  feedback  for 
enhanced  immersion  in  the  VR  system. 
Previous  research  has  shown  that  physical 
therapy  is  one  of  the  most  effective  non- 
pharmacological  treatments  for  joint  dis¬ 
ease7  and  that  haptic  interfaces  greatly  im¬ 
prove  the  immersion  of  VR  systems.  Our 
design  for  treating  adhesive  capsulitis  is 
built  around  commercially-available  devices 
originally  developed  for  the  computer  gam¬ 
ing  industry. 


Figure  1:  Creare’s  Virtual  Reality-Enhanced  Physical  Therapy  System.  Creare’s  VR-enhanced  PT 
system  combines  immersive  VR  technologies  with  physical  therapy  hardware.  The  immersive  VR 
technology  is  used  to  distract  patients  from  pain  experienced  during  physical  therapy  treatments.  By 
distracting  patients  from  pain,  the  Creare  system  holds  the  promise  of  allowing  patients  to  either  tol¬ 
erate  existing  therapy  procedures  better  or  to  enhance  the  provided  therapy.  Long  term,  it  is  reason¬ 
able  to  expect  that  the  likely  result  will  be  less  chronic  pain  and  improved  clinical  outcomes  for  pa¬ 
tients  with  joint  pain/disease. 
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Visual  Display.  To  provide  a  greater  level  of 
realism  in  the  VR  system,  we  employ  a 
head-mounted  display  (HMD)  which  pre¬ 
sents  the  visual  content  to  the  user.  By  us¬ 
ing  an  HMD,  we  try  to  fully  immerse  the 
user  into  the  VR  environment.  We  make 
use  of  off-the-shelf  HMD  hardware  and  use 
graphic  rendering  software  that  we  have 
previously  developed  for  a  VR  training  ap¬ 
plication  to  render  the  graphic  content  to  the 
user.  This  software  makes  use  of  3D  Linx,  a 
commercial  off-the-shelf  product  for  real¬ 
time  display  of  visual  content  in  games  and 
training  systems. 

Head  Tracker.  The  system  is  designed  to  en¬ 
able  the  user  to  wear  an  electromagnetic 
tracker  mounted  to  the  HMD.  The  measure¬ 
ment  of  head  motion  is  used  to  compensate 
in  real  time  for  motion  parallax  and  other 
display  anomalies  common  in  virtual  reality 
visual  displays.  In  addition,  we  can  make 
use  of  the  head  tracker  measurements  to 
present  audio  information  to  the  user  with 
proper  three-dimensional  sound  content. 


Computation  Engine.  The  computation  engine 
consists  of  hardware  for  real-time  imple¬ 
mentation  of  the  signal  processing  algo¬ 
rithms.  The  hardware  consists  of  off-the- 
shelf  computer  hardware.  The  inputs  to  the 
computation  engine  are  the  measurement 
of  the  haptic  display  input,  the  head  tracker 
device,  and  the  physics-based  models  used 
to  determine  the  behavior  of  the  virtual  envi¬ 
ronment.  The  output  from  the  computation 
engine  includes  the  visual,  auditory,  and 
haptic  displays.  We  have  previously  devel¬ 
oped  real-time  software  for  proper  timing 
and  for  analog-to-digital  and  digital-to- 
analog  conversion  while  making  use  of  off- 
the-shelf  computer  hardware  that  was  modi¬ 
fied  for  this  application. 

Underlying  Software.  The  VR-enhanced  physi¬ 
cal  therapy  system  is  designed  around  a 
module  architecture  that  permits  each  com¬ 
ponent  of  the  system  to  be  modified  without 
affecting  overall  operation  of  the  system. 
This  approach  facilitates  incorporating  new 
hardware,  VR  content,  physics-based  mod- 


Figure  2:  View  of  Graphical  Content  for  Virtual  Reality  System.  This  figure  shows  the  virtual  city  and 
landscape  that  is  used  for  the  virtual  reality  system.  The  purple  balloons  are  used  to  define  a  path  for 
the  user  to  follow  with  the  virtual  vehicle  and  the  steering  wheel  is  used  to  resist  movement  by  the 
user. 
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Figure  3.  Image  of  the  Non-Enhanced  System  Screen.  This  figure  shows  that  the  non-enhanced 
task  was  to  move  a  crosshair  using  the  steering  wheel  to  follow  a  round  bail  as  it  moved  on  the 
screen.  Torque  is  applied  to  the  steering  wheel  while  the  user  moves  the  wheel. 


els,  and  physical  therapy  routines.  This  de¬ 
sign  allows  our  system  to  be  easily  modified 
for  new  and  more  challenging  applications 
in  chronic  pain  management  that  might  re¬ 
quire  specific  physical  therapy  routines  or 
procedures. 

2.2  VR  Graphical  Content 

The  graphical  content  of  the  original  training 
system  upon  which  our  system  is  based  con¬ 
sisted  of  city  and  country  roads  over  which  the 
patient  could  drive  (shown  in  Figure  2),  all  the 
while  feeling  the  interaction  of  the  vehicle  with 
the  road  and  viewing  the  motion  of  the  vehicle 
relative  to  the  surrounding  environment.  The 
new  design  adds  a  well-defined  task  to  the  sys¬ 
tem  and  makes  use  of  the  existing  graphical 
content.  We  added  a  “game”  to  the  system  such 
that  the  driver  has  a  fixed  amount  of  time  to 
drive  over  markers  placed  on  a  number  of  the 
roads  and  part  of  the  countryside.  Each  marker 
that  is  driven  over  is  counted  and  the  patient 
achieves  a  score  based  on  the  number  of  mark¬ 
ers  “collected”  (much  like  the  old  Pac  Man  video 
game). 


2.3  Non-Enhanced  System 

In  order  to  provide  a  method  for  direct  compari¬ 
son  between  our  VR-enhanced  physical  therapy 
system  and  a  non-enhanced  system,  we  devel¬ 
oped  a  non-enhanced  system  using  the  same 
hardware  as  the  enhanced  system.  For  this  sys¬ 
tem,  the  task  was  to  follow  a  moving  round  tar¬ 
get  by  rotating  the  steering  wheel  to  move  a 
crosshair.  A  picture  of  the  screen  for  the  non- 
enhanced  implementation  is  shown  in  Figure  3. 
While  the  user  rotates  the  steering  wheel,  the 
wheel  also  applied  torque  so  that  the  user  is 
forced  to  apply  retarding  torque  and,  thereby, 
exercise  their  shoulder  muscles.  The  target  po¬ 
sition  and  torque  applied  to  the  steering  wheel 
are  “played  back”  from  a  data  file  which  con¬ 
tains  a  time  history  of  target  positions  and 
torque  values.  The  data  files  can  be  recorded 
from  previous  interactions  with  the  hardware, 
either  during  a  familiarization  session  or  during 
a  VR-enhanced  session. 

3.0  RESULTS 
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Using  the  system  described  above,  we  per¬ 
formed  a  pilot  human  subject  test  designed  to 


Subject 

Sex 

Age 

Pain  during 
non-VR 

System  to  use 
in  future 

Immersion 

Slope  (torque/ 
angle) 

1 

F 

76 

a  little  more 

VR-enhanced 

moderate 

-0.024 

2 

F 

53 

more 

VR-enhanced 

high 

-0.074 

3 

M 

78 

much  more 

VR-enhanced 

moderate 

-0.155 

4 

F 

75 

less 

Jggg|ggg| 

low 

-0.286 

5 

M 

69 

less 

low 

-0.350 

6 

F 

53 

same 

VR-enhanced 

moderate 

-0.096 

7 

F 

56 

a  little  more 

VR-enhanced 

high 

-0.096 

8 

M 

58 

a  little  more 

high 

-0.162 

Table  1 :  Summary  of  Pilot  Human  Subject  Test  Results 


investigate  the  following  hypothesis:  An  immer¬ 
sive  VR  system  can  be  used  to  distract  patients 
suffering  from  joint  disease  from  pain  during 
physical  therapy  treatment. 


three  males,  two  of  the  males  were  in  the  69-78 
age  group. 

3. 1  Pain  Perception 


We  performed  the  pilot  human  subject  test  at 
the  Massachusetts  General  Hospital  Physical 
Therapy  Clinic  with  eight  test  volunteers.  Dr. 
Michael  Kane  of  the  Massachusetts  Institute  of 
Technology  performed  the  diagnosis  of  adhe¬ 
sive  capsulitis,  recruited  all  of  the  subjects  and 
obtained  informed  consent  documents  prior  to 
their  first  visit  to  the  PT  clinic.  Once  at  the  PT 
clinic,  Ms.  Katherine  Breen,  PT,  DPT,  per¬ 
formed  a  standard  initial  PT  exam  for  all  of  the 
patients  and  reviewed  the  human  subject  test 
protocol.  Afterwards,  the  volunteers  were 
brought  to  the  area  where  the  hardware  was  set 
up  and  the  testing  began,  following  the  ap¬ 
proved  protocol.  All  of  the  test  results  are  sum¬ 
marized  in  Table  1.  The  table  shows  the  sex 
and  age  of  the  subject,  the  subject’s  responses 
to  the  questions  that  we  asked,  our  qualitative 
assessment  of  level  of  immersion  (based  on  the 
length  of  time  required  to  familiarize  with  the 
hardware  and  score  on  achieving  the  goals  of 
the  task),  and  the  calculated  slope  of  the  torque 
vs.  angle  curve  generated  by  recording  the  data 
during  the  VR-enhanced  session. 

The  test  subjects  ranged  in  age  from  53  to  78, 
with  four  between  the  ages  of  53  and  58  and 
four  between  the  ages  of  69  and  78.  The  test 
subject  population  consisted  of  five  females  and 


Overall,  five  of  the  eight  participants  ranked  the 
relative  level  of  pain  experienced  during  the  non 
VR-enhanced  session  as  being  greater  than  the 
pain  experienced  during  the  VR-enhanced  ses¬ 
sion.  Of  the  five,  three  ranked  the  pain  as  “a 
little  more  pain,”  one  ranked  the  pain  as  “more 
pain,”  and  one  ranked  the  pain  as  “much  more 
pain.”  One  test  subject  ranked  the  pain  as  being 
the  same  between  the  two  systems,  and  two 
participants  ranked  the  pain  as  being  less  dur¬ 
ing  the  non  VR-enhanced  session. 

3.2  Affective  Results 

Seven  of  the  eight  participants  found  the  VR- 
enhanced  session  to  be  more  pleasurable,  pre¬ 
ferred  to  use  the  VR-enhanced  system,  and 
would  choose  to  use  the  VR-enhanced  system 
for  continued  therapy  if  that  were  possible.  The 
one  individual  who  found  the  non  VR-enhanced 
session  to  be  more  pleasurable  also  found  the 
non  VR-enhanced  session  to  generate  less 
pain.  This  individual  also  complained  of  a  head¬ 
ache  that  may  have  occurred  because  the  HMD 
was  likely  not  adjusted  properly  (it  was  too  tight 
and  he  did  not  say  anything  until  the  session 
was  over).  We  believe  that  this  issue  with  the 
HMD  also  contributed  to  this  participant’s  lack  of 
immersion  in  the  VR  environment. 
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4.0  DISCUSSION 

The  results  of  our  pilot  study,  clearly  demon¬ 
strated  the  feasibility  of  our  VR  system.  We 
achieved  our  research  objectives  by  developing 
an  early  prototype  VR-enhanced  physical  ther¬ 
apy  system  for  frozen  shoulder;  performed  a 
pilot  human  subject  test  of  the  system;  and  de¬ 
veloped  the  design  of  a  clinical  system  appropri¬ 
ate  for  use  in  long-term  studies.  Our  test  results 
confirm  that  VR-enhancement  has  the  potential 
to  distract  individuals  from  pain  during  therapy, 
that  patients  enjoy  using  VR-enhanced  hard¬ 
ware,  and  that  patients  would  like  to  continue  to 
use  a  VR-enhanced  system  if  that  were  possi¬ 
ble. 

The  test  subject  who  ranked  the  pain  as  the 
same  used  the  VR-enhanced  system  second 
and  may  have  suffered  a  bit  from  fatigue  due  to 
the  buildup  of  exercise  from  the  intake  exam 
and  first  non  VR-enhanced  therapy  session. 
This  subject  spontaneously  said  “This  works,  I 
am  not  even  thinking  about  my  shoulder”  during 
the  VR-enhanced  session.  This  comment  indi¬ 
cates  that  the  VR-enhanced  system  was  per¬ 
forming  as  expected,  even  though  the  response 
to  the  specific  question  regarding  pain  does  not 
clearly  support  our  hypothesis. 

Neither  of  the  participants  who  ranked  the  rela¬ 
tive  level  of  pain  in  the  non  VR-enhanced  ses¬ 
sion  as  less  were  completely  immersed  in  the 
VR-enhanced  system.  Both  of  these  partici¬ 


pants  were  from  the  69-78  age  group  and  had 
a  difficult  time  keeping  the  virtual  vehicle  near 
the  path  defined  by  the  task.  In  retrospect,  we 
could  have  recorded  the  number  of  balloons  on 
the  path  that  were  “collected”  by  the  participant 
and  used  this  as  an  indication  of  immersion. 
The  two  subjects  who  experienced  more  pain 
obtained  very  low  scores  on  the  task  as  defined 
by  “collection”  of  the  balloons;  whereas  all  those 
who  scored  well  on  the  given  task,  reported 
more  pain  experienced  during  the  non  VR- 
enhanced  session. 

Further,  the  data  recorded  during  the  VR- 
enhanced  sessions  for  these  two  individuals 
showed  a  very  high  slope  of  torque  vs.  steering 
wheel  angle;  almost  twice  as  high  as  the  next 
highest  values.  This  slope  is  an  indication  of  the 
“gain”  of  the  force  feedback  or  spring  constant. 
This  indicates  that  these  subjects  had  to  work 
very  hard  to  move  the  steering  wheel  against  a 
relatively  large  resistive  force.  This  came  about 
because  both  individuals  were  not  able  to  con¬ 
trol  the  speed  of  the  virtual  vehicle  and  kept  it 
moving  at  a  relatively  high  speed  through  the 
environment.  This  had  the  dual  effect  of  making 
them  score  poorly  on  the  task  as  well  as  in¬ 
creasing  the  level  of  work  that  they  needed  to 
perform  during  the  session.  Figure  4  shows  a 
graph  of  the  torque  vs.  angle  data  for  Subjects 
#1  and  #5.  These  data  show  the  quantitative 
difference  between  the  interaction  that  the  sub¬ 
jects  had  with  the  system  during  the  VR- 
enhanced  session.  Effectively,  the  data  in  Fig- 
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Figure  4:  Torque  vs.  Angle  Data  Recorded  During  Two  VR-Enhanced  Sessions,  (a)  shows  data  from 
Subject  5  whose  effective  steering  wheel  resistance  was  large  compared  to  other  subjects,  (b)  shows 
data  from  Subject  1  whose  steering  wheel  resistance  was  comparable  to  most  of  the  other  subjects. 
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ure  4a  show  that  the  steering  wheel  resistance 
is  much  greater  than  that  shown  in  Figure  4b, 
resulting  in  greater  effort  being  expended  by  the 
participant  and  the  greater  feeling  of  pain  during 
the  VR-enhanced  session. 

We  also  noticed  that  the  individuals  in  the  69- 
78  group  were  on  average  less  familiar  with 
computer  technology  (especially  games)  and 
required  more  familiarization  time  with  the  hard¬ 
ware  than  the  individuals  from  the  53-58  group. 
Our  evidence  suggests  that  people  who  were 
more  familiar  with  the  hardware  and  computers 
were  more  likely  to  become  immersed  in  the  VR 
and  were  much  more  likely  to  be  distracted  from 
the  pain. 
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Abstract:  Children  with  disabilities  receive  various  types  of  rehabilitation  therapies,  including  physi¬ 
cal,  occupational,  and  speech/language  therapy.  The  CosmoBot™  system  is  a  robotic  toolkit  de¬ 
signed  to  motivate  and  monitor  children  with  developmental  disabilities,  aiding  them  in  therapy,  edu¬ 
cation,  and  general  developmental  progress.  This  patented  technology  includes  CosmoBot™,  an 
interactive  robot  toy,  and  Mission  Control,  an  adaptive  control  interface.  CosmoBot™  is  a  child- 
friendly  robot  that  moves  and  talks  while  controlled  by  a  user.  Mission  Control  is  a  multimodal  inter¬ 
face  that  allows  a  user  to  control  CosmoBot™  using  gestures  and  voice.  The  CosmoBot™  system 
targets  therapeutic  and  educational  goals  while  allowing  children  to  engage  in  a  play  activity.  A  feasi¬ 
bility  study  was  conducted  to  evaluate  the  effectiveness  of  the  CosmoBot™  system  for  combined 
occupational  and  speech/language  therapy.  Based  on  qualitative  data  consisting  of  feedback  from 
the  therapists  and  parents  of  the  children  participating  in  the  study  and  observations  made  by  the 
engineering  design  team,  the  CosmoBot™  system  was  found  to  be  a  useful  motivational  tool,  target¬ 
ing  a  number  of  therapeutic  and  educational  goals. 


1.  INTRODUCTION 

Children  with  developmental  disabilities  often 
must  perform  a  variety  of  therapeutic  exercises 
during  and  between  therapy  sessions  to 
strengthen  muscles,  increase  range  of  motion 
or  vocabulary,  and  address  basic  developmen¬ 
tal  goals.  While  necessary  for  achieving  devel¬ 
opmental  goals,  such  exercises  can  be  tedious, 
fatiguing,  and  sometimes  even  painful.  In  addi¬ 
tion,  there  are  currently  few  objective  methods 
for  obtaining  outcome  measurements  of  a 
child’s  therapeutic  progress  while  performing 
the  prescribed  exercises.  Therefore,  a  need 
exists  for  a  tool  that  provides  both  motivation 
and  embedded  assessment  capabilities  for 
therapeutic  and  educational  applications. 

Studies  have  shown  that  when  children  are  en¬ 
gaged  in  a  purposeful  activity,  such  as  play, 
they  are  intrinsically  motivated  and  actively  en¬ 
gaged,  yielding  better  results,  in  some  cases, 
than  those  achieved  using  rote  exercise.  One 
such  study,  conducted  by  Sakemiller  and  Nel¬ 
son,  found  that  embedding  exercise  within  a 
play  occupation  enhanced  the  prone  extension 
of  two  children  with  hypotonic  cerebral  palsy. 
AnthroTronix,  a  human  factors  and  rehabilita¬ 
tion  engineering  company,  has  designed  a 
technology  tool  to  target  developmental  goals 
within  a  play  environment. 


2.  DESIGN  AND  DEVELOPMENT 

All  rehabilitation  technologies  developed  by 
AnthroTronix  are  designed  via  a  user-centered 
model.  This  user-centered  design  process 
draws  on  input  from  the  end  users  via  focus 
groups,  formal  and  informal  interviews,  and 
system  evaluations  at  each  step  in  the  design 
process  (Figure  1).  This  method  of  design  re¬ 
sults  in  user-defined  specifications,  as  opposed 
to  engineer-defined  specifications.  The  end 
users  define  needs  to  be  met  by  the  technol¬ 
ogy.  Requirements,  capable  of  meeting  the 
specified  needs,  are  then  generated  by  the  de¬ 
sign  team.  The  users  continually  provide  feed¬ 
back  to  the  design  team  throughout  the  devel¬ 
opment  of  the  concept  design,  the  detailed 
specifications,  and  the  resulting  prototype.  The 
prototype  is  then  evaluated  by  users  in  a  ther¬ 
apy  or  educational  setting,  leading  to  product 
development  as  well  as  additional  needs  for 
subsequent  design  iterations. 

A  list  of  needs  was  identified  by  the  end  users, 
in  this  case  children  with  disabilities  and  their 
therapists,  teachers,  and  parents.  The  needs 
identified  were  that  the  technology  must  1)  pro¬ 
vide  motivation,  2)  provide  empowerment,  3)  be 
applicable  across  therapy  domains,  4)  accom¬ 
modate  a  variety  users,  5)  provide  long-term 
motivation,  6)  be  easy  to  use,  7)  provide  objec- 
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Figure  1 :  User  Centered  Design  Model 


tive  measures  of  progress,  and  8)  be  applicable 
for  both  on-site  and  remote  therapy.  From 
these  needs,  requirements  were  defined 
(Figure  2). 

As  previously  identified,  a  primary  need  (1)  de¬ 
fined  by  both  therapists  and  researchers  is  mo¬ 
tivation.  The  requirement  identified  for  the  tech¬ 
nology  to  meet  this  need  was  the  provision  of  a 
play  environment,  implicating  that  the  technol¬ 
ogy  must  involve  some  type  of  game  or  toy. 
The  second  need  (2),  that  the  therapeutic  ac¬ 
tivities  provide  empowerment  is  met  by  ena¬ 


bling  children  to  control  their  environment.  This 
provides  children  with  a  sense  of  independence 
and  accomplishment  and  prevents  the  activity 
from  being  passive.  In  addition,  this  sense  of 
control  combats  “learned  helplessness",  the 
condition  in  which  children  become  passive  and 
learn  to  depend  on  others  to  interact  with  their 
environment.  The  third  need  (3)  was  that  the 
technology  must  be  applicable  across  therapy 
and  educational  domains,  including  physical, 
occupational,  speech-language,  and  behavioral 
therapies,  as  well  as  special  education.  The 
associated  requirement,  defined  by  the  therapy 
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Figure  2:  Derivation  of  Requirements  from  User-Defined  Needs 
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Figure  3:  CosmoBot™’s  wheels  can  move  forward,  backward,  left  and  right,  its  arms  move  up  and 
down  and  together  and  apart,  and  its  head  can  move  up  and  down  (“yes”),  left  and  right  (“no”),  and 
any  combination  of  the  two. 


and  design  team,  was  that  the  technology  must 
have  variable  inputs  and  be  adaptable.  As  de¬ 
fined  by  the  fourth  need  (4),  the  technology 
must  be  designed  to  meet  the  needs  of  a  vari¬ 
ety  of  users  with  varying  types  and  degrees  of 
disabilities.  In  this  case  the  requirement  was 
defined  as  the  adaptability  of  the  technology,  as 
well  as  programmability.  This  last  need  of  pro¬ 
grammability,  is  also  associated  with  the  fifth 
need  (5),  which  is  long-term  motivation.  It  is 
important  that  the  technology  not  lose  effective¬ 
ness.  By  making  the  technology  programmable, 
it  can  effectively  meet  the  specific  needs  of  in¬ 
dividual  users,  and  continue  to  meet  their 
changing  needs  over  time.  An  important  re¬ 
quirement  for  all  technologies,  as  identified  by 
the  sixth  need  (6),  is  ease  of  use.  In  order  for 
successful  technology  transfer  to  take  place, 
the  tech  must  be  easy  to  use  by  the  child,  as 
well  as  the  child’s  therapists,  teachers,  and 
family  members.  The  design  team,  therefore 
identified  the  requirement  of  a  graphical  user 
interface  to  allow  the  users  to  easily  adjust  set¬ 
tings  and  view  data.  Therapists  also  identified 
the  need  (7)  for  the  provision  of  objective 
measures  for  assessment  and  monitoring  of 
therapeutic  progress.  This  supports  the  require¬ 
ment  for  embedded  assessment  software, 
which  will  automatically  save  quantitative  data. 
Finally,  in  order  to  meet  the  need  (8)  for  both 


on-site  and  remote  therapy,  a  final  requirement 
was  identified:  that  the  technology  include  re¬ 
mote  monitoring  capabilities. 

The  defined  needs  and  requirements  led  to  our 
initial  concept  design,  CosmoBot™,  a  child- 
friendly  robot  that  moves  and  talks  while  con¬ 
trolled  by  a  user  (Figure  3).  CosmoBot™  was 
developed  as  part  of  a  robotic  toolkit  system  to 
motivate  and  monitor  children  in  physical,  occu¬ 
pational,  and  speech/language  therapy.  The 
toolkit  includes  CosmoBot™  and  Mission  Con¬ 
trol,  an  adaptive  control  interface. 

The  robot,  shown  in  Figure  3,  contains  6  ser¬ 
vos,  controlling  head,  arm,  and  mouth  move¬ 
ments,  as  well  as  2  DC  motors  driving  a  set  of 
wheels  under  its  feet.  The  robot  also  contains 
an  analog  to  a  digital  (A/D)  board  and  a  hand¬ 
held  computer  for  receiving  commands.  The 
handheld  computer  allows  the  robot  to  be  pro¬ 
grammed  in  a  variety  of  ways  to  meet  various 
therapeutic  and  educational  goals.  By  giving 
children  control  over  the  robot’s  movements 
and  speech  they  are  empowered  with  a  sense 
of  environmental  control.  The  robot  was  de¬ 
signed  to  be  child-friendly,  as  well  as  hygienic, 
for  use  in  schools  and  clinics.  It  allows  for  a 
variety  of  control  inputs,  including  speech  and 
gestures. 
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Figure  4:  Mission  Control  is  an  adaptive  inter¬ 
face  that  allows  children  to  control  CosmoBot™ 
using  movements  and  speech. 


Mission  Control  is  a  multimodal  interface  which 
provides  wireless  control  of  CosmoBot™  over 
TCP/IP.  Like  the  robot,  this  adaptable  control 
interface  contains  a  handheld  computer,  which 
can  be  programmed  to  map  control  of  the  ro¬ 
bot’s  movements  to  a  variety  of  inputs,  includ¬ 
ing  gestures  and  voice  (Figure  4).  Gestures 
may  include  reaching  for  a  button,  operating  a 
joystick,  or  activating  wearable  sensors  through 
body  movement.  Voice  control  is  enabled 
through  voice  recognition  software,  allowing 
control  of  CosmoBot™  by  speaking  into  the 
microphone. 

The  wearable,  gestural  sensors  plug  into  Mis¬ 
sion  Control,  and  allow  the  child’s  movements 
to  be  mapped  onto  those  of  the  robot.  Figure  4 
demonstrates  one  such  sensor:  Here  the  child 
is  wearing  an  armband,  which  contains  an  ac¬ 
celerometer.  A  threshold  is  set  in  the  Mission 
Control  software  and  mapped  to  the  robot’s 
arm  movements,  so  that  when  the  child  raises 
his  arm,  the  robot  mimics  this  movement.  The 
system  can  be  configured  to  correspond  to  a 
variety  of  therapy  exercises  by  altering  the  po¬ 
sitioning  of  the  sensors  on  the  body  and  the 
threshold  of  activation  set  in  the  software, 
thereby  targeting  various  muscle  movements, 
and  therapeutic  goals  across  domains.  The 
sensors  themselves  are  designed  to  be  com¬ 
fortable,  adjustable,  and  hygienic  for  use  in  an 
educational  or  clinical  setting. 


developmental  goals  across  therapeutic  do¬ 
mains.  While  many  tools  exist  for  meeting  spe¬ 
cific  therapy  and  educational  goals,  there  are 
few  that  can  be  applied  across  physical,  occu¬ 
pational,  and  speech/language  therapies,  as 
well  as  general  developmental  goals.  Addition¬ 
ally,  the  range  of  interface  options  allows  this 
system  to  be  useful  for  a  variety  of  age  and 
disability  groups. 

3.  METHODS  OF  EVALUATION 

The  CosmoBot™  system  was  evaluated  by  the 
end  users,  in  this  case  children  with  disabilities, 
and  their  parents,  therapists,  and  teachers. 
The  objectives  of  this  evaluation  were  to  iden¬ 
tify  and  address  problems  with  the  technology, 
and  to  evaluate  its  usability  in  a  therapy  setting. 
In  order  to  do  this,  we  conducted  a  research 
study  in  a  combined  SLP  and  OT  setting,  as 
well  as  conducting  several  focus  groups  involv¬ 
ing  a  variety  of  professionals  working  with  chil¬ 
dren  with  disabilities.  The  feasibility  study  was 
funded  by  a  National  Science  Foundation 
Phase  I  SBIR.  It  took  place  at  Claremont  Acad¬ 
emy  in  Arlington,  Virginia,  where  three  children 
participating  in  combined  occupational  and 
speech/language  therapy,  and  their  therapists, 
used  the  system  during  individualized  therapy 
sessions  over  a  ten-week  period.  Prior  to  intro¬ 
ducing  the  technology,  three  baseline  therapy 
sessions  were  conducted  without  the  use  of  the 


The  novelty  of  this  innovation  is  in  the  versatility 
of  the  technology,  as  well  as  its  ability  to  target 
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Figure  5:  A  Gestural  sensor  is  used  to  control 
CosmoBot™’s  arm  movements 


technology,  informing  the  design  team  as  to  the 
practices  and  therapeutic  interventions  em¬ 
ployed  during  a  typical  therapy  session.  Sub¬ 
jects  were  recruited  based  on  the  following  cri¬ 
teria:  1)  attending  weekly  occupational  and 
speech  therapy  sessions,  2)  having  a  develop¬ 
mental  age  of  2  or  more,  and  3)  parental  con¬ 
sent.  Based  on  these  criteria,  the  following 
subjects  were  recruited  by  the  therapists:  Sub¬ 
ject  1 )  a  5-year-old  Latin  American  male  diag¬ 
nosed  with  Down  Syndrome,  Subject  2)  an  8- 
year-old  African  American  male  with  global  de¬ 
velopmental  delays,  and  Subject  3)  a  6-year- 
old  Caucasian/African  American  male  diag¬ 
nosed  with  autism.  Data  were  collected  in  the 
form  of  therapist  and  parent  interviews,  video, 
and  notes  and  observations  taken  by  the  par¬ 
ticipating  therapists  and  the  design  team. 
Qualitative  methods  informed  us  throughout  the 
study  of  problems  and  successes  in  Cos- 
moBot™’s  usability,  as  well  as  general  and 
specific  responses  to  CosmoBot™  by  partici¬ 
pants.  Each  session  was  videotaped.  Thera¬ 
pists  and  an  observer  used  a  questionnaire  to 
record  data.  A  second  observer  not  affiliated 
with  the  study  took  data  on  every  third  session. 
Questionnaires  covered  therapeutic  ap¬ 
proaches  used  and  adjustments  needed, 
speech/language  and  occupational  therapy 
goals  addressed,  participant  responses  to  the 
technology,  and  compatibility  of  the  technology 
with  treatment. 

4.  RESULTS 

Based  on  the  feedback  from  the  therapists  and 
parents  of  the  children  in  the  study,  as  well  as 
observations  made  by  the  engineering  design 
team,  the  CosmoBot™  system  was  determined 
to  be  a  useful  motivational  tool,  targeting  a 
number  of  therapeutic  and  educational  goals. 
The  system  was  found  to  be  particularly  useful 
for  facilitating  directed  play  involving  auditory 
processing,  following  directions,  spatial  posi¬ 
tioning,  matching  and  associations,  and  verbali¬ 
zation  of  associations.  CosmoBot™  was  also 
successful  in  targeting  social  greetings,  eye 
contact,  2-word  utterances,  language  concepts, 
auditory  processing,  word  association  skills, 
and  coordination  and  understanding  of  body 
positions  in  space.  Individual  subject  results,  as 
indicated  by  the  therapists,  and  video  observa¬ 
tions  were  as  follows: 


Figure  6:  An  occupational  therapist  and 
speech-language  pathologist  use  CosmoBot™ 
to  facilitate  an  integrated  therapy  session  with 
two  of  the  study  participants  while  a  member  of 
the  engineering  design  team  observes. 


Subject  1  liked  the  technology  and  was  highly 
enthusiastic.  The  technology  assisted  in  ena¬ 
bling  him  to  produce  spontaneous  and  imitative 
single  words.  The  therapists  also  noted  that 
from  the  start,  he  smiled  a  lot  when  in  the  pres¬ 
ence  of  “Bot”.  When  the  therapists  were  dis¬ 
tracted  for  a  minute,  he  was  definitely  in  charge 
of  “Bot”.  Subject  2  was  highly  enthusiastic  and 
especially  enjoyed  speaking  through  the  micro¬ 
phone.  As  the  sessions  progressed,  he  began 
to  speak  more  spontaneously,  using  the  micro¬ 
phone  as  a  tool;  he  seemed  empowered  by  this 
experience.  Additionally,  Subject  2  was  sensi¬ 
tive  to  whether  or  not  the  technology  was  work¬ 
ing.  It  was  clear  that  when  CosmoBot™  was 
fully  functional,  he  was  more  motivated  to  en¬ 
gage  in  the  session’s  activities  and  he  dis¬ 
played  more  energy.  During  these  sessions 
there  was  a  smooth  transition  between  activi¬ 
ties,  an  increased  number  of  activities,  and 
consistent  attentiveness.  Subject  3  was  highly 
enthusiastic;  he  spontaneously  gave  verbal 
commands  to  “Bot”  and  also  imitated  several 
commands.  He  enjoyed  manipulating  the  con¬ 
trols,  and  easily  controlled  “Bot”.  It  was  clear 
from  the  video  analysis  that  even  when  no  one 
else  could  get  this  subject  focused  on  a  thera¬ 
peutic  activity,  CosmoBot™  commanded  his 
attention. 

Additional  feedback  was  obtained  during  sev¬ 
eral  focus  groups  involving  a  variety  of  profes¬ 
sionals  working  in  the  fields  of  physical  therapy, 
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occupational  therapy,  speech/language  ther¬ 
apy,  and  special  education.  Two  such  focus 
groups  were  conducted  at  the  California  State 
University  at  Northridge  Center  on  Disability 
conference  in  March  of  2002  and  2003.  An  ad¬ 
ditional  focus  group  was  conducted  in  Novem¬ 
ber  of  2002  at  Kennedy  Krieger  School  in  Mary¬ 
land,  which  is  a  non-public  special  education 
facility  employing  several  speech  language  pa¬ 
thologists.  These  focus  groups  provided  the 
basis  for  prototype  evaluation  and  incorporation 
of  changes  for  the  subsequent  design  iteration. 
At  each  of  the  three  focus  groups  the  partici¬ 
pants  were  asked  to  identify  critical  problems  or 
needs  of  children  that  might  benefit  from  using 
CosmoBot™;  some  examples  identified  in¬ 
cluded  aiding  with  pretend  play,  manipulative 
play,  physical  activities  within  the  classroom 
(e.g.  circle  time,  song  leading),  direction  words, 
action  words,  creative  play  and  action  learning 
processes,  and  concept  development.  Addi¬ 
tional  applications  identified  included  modeling 
use  of  a  switch,  data  logging  to  monitor  an  ac¬ 
tivity  such  as  hitting  a  switch  or  calculating  the 
mean  length  of  utterance  (MLU),  acting  as  a 
receiver  of  communication  to  facilitate  interac¬ 
tion,  aiding  in  language  for  movement/  spatial 
concepts,  sequencing,  using  as  a  calming  ef¬ 
fect  for  sensory  integration,  and  turn  taking. 
The  results  of  the  focus  groups  were  particu¬ 
larly  helpful  in  identifying  development  plans  for 
interventions  to  meet  therapeutic  goals  and 
content  ideas  for  future  interactive  content. 

5.  DISCUSSION 

This  study  demonstrated  the  technical  feasibil¬ 
ity  of  a  robotic  toolkit  for  pediatric  rehabilitation 
in  combined  occupational  and  speech/language 
therapy.  Specific  therapeutic  interventions  were 
identified  for  each  of  the  functional  goals  and 
objectives.  From  a  clinical  perspective,  Cos¬ 
moBot™  showed  potential  to  make  an  impact 
on  the  speech  and  language  development  of 
several  children  while  contributing  to  their  moti¬ 
vation  for  learning.  All  of  the  children  were 
highly  motivated  by  the  technology  and  made 
some  progress  toward  their  goals.  Feedback 
from  the  end  users  (children  with  disabilities, 
families  of  children  with  disabilities,  and  thera¬ 
pists),  as  well  as  observations  from  the  engi¬ 
neering  and  design  team,  provided  the  basis  for 
prototype  evaluation  and  incorporation  of 
changes  for  the  subsequent  design  iteration. 


Currently,  AnthroTronix  is  manufacturing  a  sec¬ 
ond  generation  prototype  for  use  during  clinical 
testing  at  two  outpatient  therapy  sites  and  one 
school.  It  is  hoped  that  clinical  testing  will  pro¬ 
vide  qualitative  data  supporting  this  research 
effort,  investigating  the  effectiveness  of  the 
CosmoBot™  system  in  targeting  therapy  and 
educational  goals.  The  clinical  testing  will  use 
controlled  experiment  design  and  data  collec¬ 
tion  methods  to  obtain  objective  and  concrete 
data  to  validate  this  research.  Feedback  ob¬ 
tained  during  clinical  testing  will  also  enable  us 
to  move  toward  a  commercial  product  for  use 
by  therapists,  teachers,  and  other  professionals 
working  with  children  with  disabilities. 
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Abstract:  This  paper  describes  mental  commit  robots  that  provide  psychological,  physiological,  and 
social  assistance  to  human  beings  through  physical  interaction.  These  robots  look  like  real  animals 
such  as  cats  and  seals.  The  seal  robot  was  developed  especially  for  therapy.  The  seal  robots  have 
been  applied  to  assisting  the  activity  of  elderly  people  at  a  health  service  facility  for  the  aged.  In  order 
to  investigate  the  psychological  and  social  effects  of  the  seal  robots  on  the  elderly  people,  we  evalu¬ 
ated  the  elderly  people's  moods  by  face  scales  (which  express  a  person’s  moods  by  illustration  of 
faces)  and  the  Profile  of  Mood  States  (which  measures  a  person’s  moods  via  questionnaire).  Seal 
robots  were  provided  for  the  facility  for  three  weeks.  Our  study  shows  that  the  feelings  of  the  elderly 
people  were  improved  by  interaction  with  the  seal  robots. 


1.  INTRODUCTION 
1.1.  Aged  Society 

Due  to  the  improvement  of  our  living  environ¬ 
ment,  dietary  life,  and  medical  progress,  people 
are  now  living  longer  than  they  ever  have  be¬ 
fore.  According  to  the  United  Nations,  a  ratio  of 
people  65  years  old  and  over  against  total 
population  of  a  country  exceeding  7%  indicates 
an  aging  society.  A  ratio  exceeding  14%  indi¬ 
cates  an  aged  society.  Fig.1  shows  change  of 
the  ratio  of  most  advanced  countries.  Now, 
countries  other  than  the  U.S.  are  aged  societies 


Figure  1 :  Ratio  of  people  65  years  old  and  over 
against  total  population  of  most  countries 


[1].  Moreover,  an  increasing  ratio  is  predicted 
for  the  future.  Therefore,  the  number  of  elderly 
people  who  need  nursing  because  of  dementia, 
disabilities  which  keep  them  bedridden,  etc.,  is 
increasing.  There  are  many  people  who  will  stay 
in  an  elderly  institution  for  a  long  time,  until  the 
end  of  their  life.  Moreover,  the  body  and  mental 
poverty  of  nursing  staffs  caused  by  manpower 
shortages  and  increased  loads  are  becoming  a 
big  problem.  The  mental  stress  of  nursing 
causes  Burnout  syndrome  [2],  which  causes 
members  of  the  nursing  staff  to  feel  irritated  and 
lose  sympathy  with  patients.  Therefore,  it  is  im¬ 
portant  to  improve  the  quality  of  life  (QOL)  of 
elderly  people  because  this  helps  them  to 
spend  their  life  healthily  and  independently.  It 
also  saves  social  costs  for  elderly  people. 

1.2.  Animal  Assisted  Therapy  and  Activity 

It  has  been  said  for  many  years  that  interaction 
with  animals  heals  the  human  mind.  In  recent 
years,  the  positive  effects  of  animal/human  in¬ 
teraction  upon  humans  has  been  researched 
and  scientifically  proven.  Friedmann  investi¬ 
gated  the  one-year  survival  rate  of  patients  who 
were  discharged  from  a  coronary  care  unit.  The 
survival  rate  of  people  who  kept  pets  was  higher 
than  that  of  those  who  did  not  [3].  Baun  re¬ 
ported  that  blood  pressure  lowered  when  peo¬ 
ple  were  stroking  their  dogs  [4].  Garrity  investi¬ 
gated  elderly  people  who  were  socially  isolated 
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Figure  2:  Objective  and  subjective  evaluations  classified  by  application  in  the  design  of  artificial  ob¬ 
jects 


and  had  lost  their  partner  within  the  past  year.  occurs  when  patients  interact  with  animals  dur- 
The  morbidity  rate  of  depression  of  people  who  ing  leisure  time,  during  which  attention  is  not 

did  not  keep  any  pets  was  higher  than  that  of  paid  to  the  special  goals  of  the  treatments.  The 

those  who  kept  pets  [5].  activities  depend  on  volunteers.  Following  are 

three  effects  that  are  expected  as  a  result  of 
The  effects  of  animals  have  also  been  applied  animal  assisted  therapy  and  activity: 
in  medical  settings.  Especially  in  the  United 

States,  animal  assisted  therapy  and  activity  are  1 .  Psychological  effect  (e.g.  relaxation,  moti- 
becoming  prevalent  at  hospitals  and  nursing  vation) 

homes.  There  are  clear  goals  for  animal  as-  2.  Physiological  effect  (e.g.  improvement  of 
sisted  therapy.  A  doctor,  nurse,  or  social  worker  vital  sign) 

makes  a  program  for  therapy  in  cooperation  3.  Social  effect  (e.g.  activation  of  communica- 
with  volunteers.  Animal  assisted  activity  also  tion  among  inpatients  and  caregivers) 

In  addition  to  these  effects,  animal  assisted 
therapy  at  nursing  homes  also  acts  as  rehabili¬ 
tation  therapy  for  elderly  people  who  have  de¬ 
creased  in  moving  ability,  and  provides  an  op¬ 
portunity  for  laughter  and  enjoyment  to  a  patient 
who  has  few  remaining  joys  in  his  life  [6].  More¬ 
over,  there  have  been  cases  where  the  therapy 
has  improved  the  state  of  elderly  people  who 
had  dementia.  However,  most  hospitals  and 
nursing  homes,  especially  in  Japan,  do  not  ac¬ 
cept  animals,  even  though  they  admit  the  posi¬ 
tive  effects  of  animal  assisted  therapy  and  activ¬ 
ity.  They  are  afraid  of  the  possible  negative  ef¬ 
fects  of  animals  such  as  allergies,  bites,  and 
scratches  which  might  cause  infection. 
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Figure  3:  Subjective  interpretation  through  in¬ 
teraction 


1.3.  Mental  Commit  Robot 


The  field  of  robotics  has  been  largely  used  for 
automation  in  industrial  manufacturing.  Most  of 
those  are  machines  optimizing  practical  sys¬ 
tems  in  terms  of  objective  measures  such  as 
accuracy,  speed,  and  cost  (Fig. 2).  Therefore, 
humans  give  machines  suitable  methods,  pur¬ 
poses,  and  goals.  Machines  are  passive  tools  of 
humans. 

We  have  been  researching  different  robots  from 
such  machines.  If  a  robot  were  able  to  generate 
its  own  motivation  and  behave  voluntarily,  it 
would  be  able  to  influence  its  interactions  with 
humans.  At  the  same  time,  the  robot  would  not 
be  a  simple  tool  for  human  use,  nor  be  evalu¬ 
ated  only  in  terms  of  objective  measures.  We 
have  been  building  animal-type  robots  as  exam¬ 
ples  of  artificial  emotional  creatures  [7-18]  since 
1993.  The  animal  robots  have  physical  bodies 
and  behave  actively  while  generating  goals  and 
motivations  by  themselves.  They  interact  with 
human  beings  physically.  People  recognize  the 
robots  and  subjectively  interpret  their  movement 
based  on  knowledge  and  experience  (Fig. 3). 

When  we  engage  physically  with  an  animal-type 
robot,  it  stimulates  our  affection.  Then  we  have 
positive  emotions  such  as  happiness  and  love, 
or  negative  emotions  such  as  anger  and  fear. 
Through  physical  interaction,  we  develop  at¬ 
tachment  to  the  animal  robot  while  evaluating  it 
as  intelligent  or  stupid  by  our  subjective  meas¬ 
ures.  In  this  research,  animal-type  robots  that 
produce  such  mental  effects  in  human  beings 
are  referred  to  as  “mental  commit  robots.”  We 
have  developed  dog  and  cat  robots  as  familiar 
animals  to  humans,  and  a  seal  robot  as  a  non¬ 
familiar  animal. 

When  people  in  public  evaluated  the  dog  or  cat 
robots,  they  became  severe  in  their  subjective 
evaluation  because  they  compared  the  robots 
with  their  images  of  real  animals.  On  the  other 
hand,  in  the  case  of  seal  robot,  people  accepted 
it  as  it  was  without  criticism.  Therefore,  the  seal 
robot  was  more  acceptable  to  the  public. 

1.4.  Robot  Therapy 

The  seal  robot  was  improved  so  it  could  be  ap¬ 
plied  to  therapy  at  hospitals  and  elderly  institu¬ 
tions.  The  seal  robot  had  been  used  in  child 
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Figure  4:  Seal  robot  “Paro” 


therapy  at  a  university  hospital  for  four  months 
in  2000  [14,  15].  This  was  referred  to  as  robot- 
assisted  therapy  (RAT).  The  moods  of  the  chil¬ 
dren  were  improved  by  interacting  with  the  ro¬ 
bot.  Moreover,  the  robot  encouraged  the  chil¬ 
dren  to  communicate  with  each  other  and  their 
caregivers  (Fig. 5).  In  one  striking  instance,  a 
young  autistic  patient  recovered  his  appetite 
and  speech  abilities  during  the  weeks  when  the 
robot  was  at  the  hospital.  In  another  case, 
nurses  noted  the  rehabilitative  benefits  for  a 
long-term  patient,  unable  to  leave  her  bed,  who 
was  willing  to  stroke  and  pet  the  seal  robot 
(Fig-6). 


Figure  5:  Interaction  between  inpatient  and  seal 
robot,  and  social  interaction  between  children. 
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Figure  6:  Interaction  between  child  inpatient  on 
bed  and  seal  robot 


After  Paro’s  introduction  to  the  elderly  people, 
interaction  with  the  seal  robots  improved  their 
moods,  made  them  more  vigorous,  and  encour¬ 
aged  them  to  communicate  with  each  other  and 
their  caregivers  (Fig.8).  Moreover,  results  of 
urinary  testing  showed  that  interaction  with  Paro 
reduced  the  stress  of  the  elderly.  In  an  interest¬ 
ing  instance,  an  elderly  lady  who  seldom  talked 
with  other  people  became  quite  communicative 
towards  others  when  she  was  interacting  with 
the  seal  robot.  In  addition,  the  seal  robot  influ¬ 
enced  people  who  had  dementia.  One  example 
is  an  elderly  lady  who  did  not  try  to  behave  in¬ 
dependently,  and  often  forgot  things  that  she 
had  just  done.  When  she  was  interacting  with 
the  seal  robot,  she  often  laughed  and  she 


In  addition,  we  have  used  seal  robots  in  robot- 
assisted  activity  (RAA)  for  elderly  people  who 
visit  a  day  service  center  [1 5-1 8].  The  day  ser¬ 
vice  center  is  an  institution  that  aims  to  de¬ 
crease  the  nursing  load  on  the  family  by  taking 
care  of  the  elderly  people  during  the  day. 

Fig.7  shows  a  scene  of  usual  life  of  elderly  peo¬ 
ple  at  the  day  service  center.  They  didn’t  com¬ 
municate  with  each  other  much,  even  if  a  care¬ 
giver  talked  to  them  and  tried  to  foster  commu¬ 
nication.  The  atmosphere  of  the  day  center  was 
dark.  One  of  the  main  reasons  for  this  was  a 
lack  of  a  common  conversation  topic,  as  the 
various  people  lived  unrelated  lives. 


Figure  8:  Interaction  between  elderly  people 
and  seal  robot  at  a  day  service  center 


Figure  7:  Scene  of  usual  life  of  elderly  people 
at  a  day  service  center 


seemed  brighter  than  usual.  Another  example  is 
an  elderly  lady  who  tended  to  want  to  go  back 
home,  but  who  kept  staying  at  the  day  service 
center  to  play  with  the  seal  robot,  and  looked 
happy.  We  also  investigated  the  nursing  staff’s 
mental  distress  as  a  result  of  taking  care  of  the 
elderly  people.  The  results  showed  that  their 
mental  distress  decreased  because  the  elderly 
people  spent  their  time  by  themselves  with  the 
seal  robots. 

Furthermore,  some  animal-type  robots  (such  as 
Furby,  AIBO  [19],  NeCoRo,  etc.)  have  been 
commercially  released  by  several  companies  in 
recent  years.  There  have  been  studies  conduc¬ 
ing  RAA  with  these  robots.  For  example,  Yoko- 
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yama  introduced  AIBO  to  a  pediatrics  word,  and 
observed  the  interaction  between  the  children 
and  AIBO  [20].  He  pointed  out  that  the  stimulus 
received  from  AIBO  was  effective  at  the  begin¬ 
ning,  but  its  stability  was  quite  weak  compared 
with  the  living  animal.  In  other  words,  if  we  meet 
AIBO  or  an  animal  for  the  first  time,  for  a  while 
we  will  be  stimulated  and  move.  However,  the 
relaxed  effect  comes  as  a  result  of  stroking  a 
dog  for  a  long  time  is  not  felt  when  interacting 
with  AIBO. 

In  this  paper,  we  applied  seal  robots  to  assisting 
the  activity  of  elderly  people  at  a  health  service 
facility  for  the  aged,  in  order  to  investigate  the 
psychological  and  social  effects  of  seal  robots 
on  the  elderly  people  who  stayed  at  the  facility. 
We  also  compared  the  effects  of  the  seal  robot 
and  those  of  a  placebo  seal  robot  that  had  a 
less  active  motion  generation  program. 

Section  2  explains  the  details  of  the  seal  robot 
and  the  placebo  seal  robot  that  were  used  for 
RAA.  Section  3  describes  ways  of  providing 
RAA  to  elderly  people.  Chapter  4  explains  the 
effects  of  RAA.  Section  5  discusses  current  re¬ 
sults  of  RAA  and  future  works.  Finally,  section  6 
concludes  this  paper. 


2.  SEAL  ROBOT  AND  PLACEBO  SEAL 
ROBOT 

2. 1.  Specifications  of  Seal  Robot 

A  seal  robot,  Faro,  was  developed  for  physical 
interaction  with  human  beings  (Fig.4).  Paro 
looks  like  a  baby  harp  seal,  which  has  white  fur 
for  three  weeks  after  its  birth.  As  for  perception, 
Paro  has  tactile,  visual,  auditory,  and  posture 
sensors  beneath  its  soft,  white,  artificial  fur.  In 
order  for  Paro  to  have  a  soft  body,  a  tactile  sen¬ 
sor  was  developed  and  implemented.  As  for 
action,  Paro  has  seven  actuators;  two  for  each 
eyelid,  two  for  the  neck,  one  for  each  front  fin, 
and  one  for  the  two  rear  fins.  Paro  weighs  about 
3.0  [kg], 

Paro  has  a  behavior  generation  system  that 
consists  of  two  hierarchical  layers  of  process¬ 
ing:  proactive  and  reactive  processes  (Fig.9). 
These  two  layers  generate  three  kinds  of  be¬ 
haviors;  proactive,  reactive,  and  physiological 
behaviors: 

(1)  Proactive  Behaviors:  Paro  has  two  layers 
to  generate  its  proactive  behaviors:  behavior¬ 
planning  layer  and  behavior-generation  layer. 


Figure  9:  Behavior  generation  system  of  Paro 
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Considering  internal  states,  stimuli,  desires,  and 
a  rhythm,  Paro  generates  proactive  behaviors. 

(a)  Behavior-planning  layer:  This  has  a  state 
transition  network  based  on  internal  states  of 
Paro  and  Paro’s  desire  produced  by  its  internal 
rhythm.  Paro  has  internal  states  that  can  be 
named  with  words  of  emotions.  Each  state  has 
a  numerical  level  and  is  changed  by  stimulation. 
The  state  decays  with  time.  Interaction  changes 
its  internal  states  and  creates  Paro’s  character. 
The  behavior-planning  layer  sends  basic  behav¬ 
ioral  patterns  to  behavior-generation  layer.  The 
basic  behavioral  patterns  include  some  poses 
and  some  motions.  Here,  although  “proactive"  is 
referred,  proactive  behaviors  are  very  primitive 
compared  with  those  of  human  beings.  We  im¬ 
plemented  behaviors  similar  to  that  of  a  real 
seal  into  Paro. 

(b)  Behavior  generation  layer:  This  layer  gen¬ 
erates  control  references  for  each  actuator  to 
perform  the  determined  behavior.  The  control 
reference  depends  on  strength  of  internal  states 
and  their  variation.  For  example,  parameters 
change  speed  of  movement,  and  the  number  of 
the  same  behavior.  Therefore,  although  the 
number  of  basic  patterns  is  countable,  the  num¬ 
ber  of  emerging  behaviors  is  uncountable  be¬ 
cause  numeral  parameters  are  various.  This 
creates  life-like  behaviors.  In  addition,  as  for 
attention,  the  behavior-generation  layer  adjusts 
parameters  of  priority  of  reactive  behaviors  and 
proactive  behaviors  based  on  strength  of  inter¬ 
nal  states.  This  function  contributes  to  Paro’s 
situated  behavior,  and  makes  it  difficult  for  a 
subject  to  predict  Paro’s  actions. 

(c)  Long-term  memory:  Paro  has  a  function  of 
reinforcement  learning.  It  puts  a  positive  value 
on  preferable  stimulations  such  as  strokes.  It 
also  puts  negative  values  on  undesirable  stimu¬ 
lations  such  as  when  it  is  beaten.  Paro  puts  val¬ 
ues  on  relationships  between  stimulation  and 
behaviors.  Gradually,  Paro  can  be  shaped  to 
preferable  behaviors  of  its  owner. 

(2)  Reactive  behaviors:  Paro  reacts  to  sudden 
stimulation.  For  example,  when  it  hears  a  sud¬ 
den  loud  noise,  Paro  pays  attention  to  it  and 
looks  in  its  direction.  There  are  some  patterns  of 
combination  of  stimulation  and  reaction.  These 
patterns  are  assumed  as  conditioned  and  un¬ 
conscious  behaviors. 


(3)  Physiological  behaviors:  Paro  has  the 
rhythm  of  a  day.  It  has  some  spontaneous  de¬ 
sires  such  as  sleep  based  on  the  rhythm. 

2.2.  Specifications  of  Placebo  Seal  Robot 

We  often  lose  interest  in  toys  when  we  find  their 
mechanism.  Therefore,  we  considered  the  fol¬ 
lowing  hypothesis: 

The  robots  that  execute  only  defined  simple 
motions  have  their  motions  predicted  by  people, 
and  they  lose  interest  in  the  robots.  Moreover, 
the  robots  also  stop  having  effects  on  those 
people. 

According  to  this  hypothesis,  we  changed  regu¬ 
lar  Paro’s  program,  and  made  a  placebo  Paro 
as  follows: 

Proactive  behaviors:  repetition  of  following  five 
kinds  of  actions. 

(1)  Blink 

(2)  Swing  rear  fins  to  right  and  left 

(3)  Swing  both  front  fins  to  forward  and  back¬ 
ward 

(4)  Swing  head  to  right  and  left 

(5)  Cry.  Return  to  (1) 

Reactive  behaviors:  following  simple  reactions 
against  stimuli. 

(1 )  Cry  (sound  is  different  from  proactive  mo¬ 
tion’s  cry) 

(2)  Raise  head 


Figure  10:  Scene  of  usual  life  of  elderly  people 
at  a  health  service  facility 
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3.  ROBOT  ASSISTED  ACTIVITY  FOR 
ELDERLY  PEOPLE 

We  applied  Paro  to  robot-assisted  activity  for 
elderly  people  at  a  health  service  facility  for  the 
aged  in  order  to  investigate  its  effects  on  elderly 
people.  The  health  service  facility  for  the  aged 
is  an  institution  that  provides  several  services, 
such  as  long-term  care  at  the  institution,  day 
care,  and  rehabilitation  for  elderly  people.  Peo¬ 
ple  who  need  nursing  can  stay  there  for  a  cer¬ 
tain  period.  During  their  stay  at  the  institution 
they  are  provided  with  daily  care  and  trained  to 
spend  their  daily  life  independently  in  order  to 
rehabilitate  them  into  society.  When  we  began 
the  study  at  the  institution,  about  100  elderly 
people  were  staying  there.  Moreover,  about  30 
of  them  had  dementia.  People  who  did  not  have 
dementia  stayed  in  A  and  B  building,  while  peo¬ 
ple  who  had  dementia  stayed  in  C  building 
where  they  were  isolated  from  other  people. 

Fig. 10  shows  a  scene  of  usual  life  of  elderly 
people  who  stayed  at  A  and  B  building,  which 
had  a  dark  atmosphere. 

The  elderly  did  not  communicate  with  each 
other  much.  The  reason  was  a  lack  of  common 
conversation  topics.  Moreover,  the  caregivers 
were  too  busy  taking  care  of  all  the  patients, 
and  so  they  did  not  spent  much  time  with  each 
person. 

Before  starting  the  robot-assisted  activity,  we 
explained  the  purposes  and  procedures  of  the 
study  to  the  elderly  people  who  stayed  in  A  and 
B  building,  and  received  their  approval.  As  ex¬ 
pected,  the  elderly  people  in  A  and  B  building 
were  staying  at  the  day  center  for  a  variety  of 
reasons.  Some  people,  however,  were  impossi¬ 
ble  to  investigate.  A  nursing  staff  that  was  well 
versed  in  the  usual  states  of  the  elderly  people 
evaluated  them,  and  decided  who  could  be  in¬ 
vestigated.  After  the  evaluation,  there  were  23 


A 

B 

Total  number  of  people 

12 

11 

Male 

4 

2 

Female 

8 

9 

Age(AV  ±SD) 

84.6±7.0 

85.5  ±5,4 

Table  1 :  Basic  attributes  of  23  subjects 


subjects.  12  subjects  stayed  in  A  building,  and 
1 1  subjects  were  in  B  building.  Their  basic  at¬ 
tributes  are  shown  in  Table  1 .  (Note:  AV  means 
their  average  age.  SD  means  their  standard 
deviation.) 

3.1.  Ways  of  Activity 

The  regular  Paro  robot  was  provided  to  the  sub¬ 
jects  who  stayed  in  B  building,  and  the  placebo 
was  provided  to  the  subjects  who  stayed  in  A 
building.  In  order  to  prevent  the  subjects  of  each 
group  interacting  with  the  other  group’s  Paro, 
each  group  interacted  with  their  Paro  in  a  differ¬ 
ent  place  in  the  institution.  Moreover,  we  kept 
the  existence  of  two  different  kinds  of  Paro  ro¬ 
bots  secret  from  the  subjects.  Each  group  inter¬ 
acted  with  their  Paro  for  about  one  hour  at  a 
time,  four  days  a  week,  for  three  weeks.  We 
prepared  a  desk  upon  which  to  set  Paro  in  the 
center  of  people,  and  the  subjects  were  ar¬ 
ranged  up  as  shown  Fig.11.  However,  not  all 
the  subjects  could  interact  with  Paro  at  the 
same  time.  Therefore,  we  moved  Paro  among 
subjects  in  turn,  and  we  ensured  that  each  sub¬ 
ject's  interaction  time  with  Paro  was  the  same. 


Figure  11:  Interaction  between  elderly  people 
and  Paro  at  a  health  service  facility 


3.2.  Ways  of  Evaluation 

In  order  to  investigate  elderly  people's  moods 
before  and  after  the  introduction  of  Paro  to  the 
institution,  the  following  two  kinds  of  data  and 
information  were  collected: 

(1)  Face  scale  [21]  (Fig. 12) 

(2)  Profile  of  Mood  States  (POMS)  [22] 

(3)  Comments  of  the  nursing  staff 


99 


(,  1  6  9  10 


11  12  n  14  15 


16  n  I?  19  20 

INSTRUCTIONS:  The  faces  above  go  from  very  happy  at 
the  top  to  very  sad  at  the  bottom.  Check  the  face  which 
best  shows  the  way  you  have  felt  inside  now 

Figure  12:  Face  scale 


The  Face  Scale  contains  20  drawings  of  a  sin¬ 
gle  face,  arranged  in  serial  order  by  rows,  with 
each  face  depicting  a  slightly  different  mood 
state.  A  graphic  artist  was  consulted  so  that  the 
faces  would  be  portrayed  as  genderless  and 
multiethnic.  Subtle  changes  in  the  eyes,  eye¬ 
brows,  and  mouth  were  used  to  represent 
slightly  different  levels  of  mood.  They  are  ar¬ 
ranged  in  decreasing  order  of  mood  and  num¬ 


bered  from  1  to  20,  with  1  representing  the  most 
positive  mood  and  20  representing  the  most 
negative  mood.  As  the  examiner  pointed  to  the 
faces,  the  following  instructions  were  given  to 
each  patient:  “The  faces  below  go  from  very 
happy  at  the  top  to  very  sad  at  the  bottom. 
Check  the  face  which  best  shows  the  way  you 
have  felt  inside  now.” 

The  POMS  is  a  weil-respected  questionnaire 
which  measures  a  person's  moods  [22].  The 
POMS  is  used  in  a  variety  of  research  fields 
such  as  medical  therapy  and  psychotherapy.  It 
can  measure  six  mood  states  at  the  same  time: 
Tension-Anxiety,  Depression-Defection,  Anger- 
Hostility,  Vigor,  Fatigue,  and  Confusion.  It  has 
65  items  concerning  moods.  Each  item  was 
evaluated  by  five  stages  of  0-4:  0  =  not  at  all,  1 
=  a  little,  2  =  moderately,  3  =  quite  a  bit  and  4  = 
extremely.  58  of  65  items  are  classified  into  the 
six  mood  states,  and  we  calculate  total  scores 
of  each  mood  states.  (Note:  7  items  are  dummy 
items)  Then,  we  translated  the  total  scores  into 
standard  scores  by  using  a  special  table. 

4.  RESULTS  OF  ROBOT  ASSISTED 
ACTIVITY 

The  face  scale  and  the  POMS  were  applied  to 
the  subjects  a  week  before  the  introduction  of 
Paro,  and  the  second  and  third  week  after 
Paro’s  introduction. 

As  for  the  face  scale,  we  obtained  data  from  7 
people  in  the  regular  Paro  group,  and  from  1 1 
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Figure  13:  Average  face  scale  scores  of  elderly 
people  for  4  weeks 
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Figure  14:  Average  standard  scores  of 
“Depression-Dejection”  of  POMS  of  elderly  peo¬ 
ple  for  4  weeks 


Figure  15:  Standard  scores  of  “Depression- 
Dejection”  of  POMS  of  an  elderly  person  for  4 
weeks 


people  in  the  placebo  Paro  group.  Fig. 13  shows 
average  face  value.  Average  scores  of  the  regu¬ 
lar  Paro  group  decreased  from  about  9.0 
(before  introduction)  to  7.0  (third  week).  More¬ 
over,  the  average  score  of  the  placebo  Paro 
group  also  decreased  from  about  7.0  (before 
introduction)  to  6.3  (third  week).  Therefore,  in¬ 
teraction  with  both  regular  and  placebo  Paro 
improved  the  mood  of  the  subjects. 

As  for  the  POMS,  we  obtained  data  from  three 
people  in  the  regular  Paro  group,  and  from  nine 
people  in  the  placebo  Paro  group.  Fig. 14  shows 
average  standard  scores  of  Depression- 
Dejection.  Here,  50  standard  points  means  av¬ 
erage  score  of  Depression-Dejection  of  Japa¬ 


Figure  16:  Old  man  who  was  singing  songs  to 
Paro 


nese  people  over  60  years  of  age.  Average 
standard  scores  of  the  regular  Paro  group  de¬ 
creased  from  about  61  (before  introduction)  to 
47  (third  week).  Moreover,  the  average  stan¬ 
dard  score  for  the  placebo  Paro  group  also  de¬ 
creased  from  about  58  (before  introduction)  to 
51  (third  week).  Therefore,  interaction  with  both 
the  regular  and  placebo  Paro  decreased  the 
levels  of  depression  and  dejection  of  the  sub¬ 
jects. 

In  one  striking  instance,  Fig. 15  shows  the  result 
of  a  male  subject  aged  96  years  old.  He  was 
usually  not  sociable,  and  caregivers  could 
hardly  communicate  to  him.  Before  the  introduc¬ 
tion  of  Paro,  his  standard  score  of  "Depression- 
Dejection”  as  measured  by  the  POMS  was  very 
high.  However,  after  the  introduction  of  Paro,  he 


Figure  17:  Elderly  people  who  tried  to  feed 
snacks  to  Paro 


came  to  like  Paro  very  much.  He  often  laughed 
and  sung  songs  to  Paro  when  he  was  interact¬ 
ing  with  the  robot  (Fig. 16).  He  also  made  the 
surrounding  people  laugh.  Caregivers  were  sur¬ 
prised  by  his  change.  Moreover,  his  standard 
score  dramatically  decreased  to  44  in  the  third 
week  after  Paro’s  introduction. 

Average  standard  scores  of  other  factors  such 
as  “Tension-Anxiety,”  “Anger-Hostility,” 
“Fatigue,”  and  “Confusion”  also  decreased. 
However,  these  scores  didn’t  change  as  much 
as  “Depression-Dejection.”  Scores  also  de¬ 
creased  for  “Vigor.”  We  think  this  shows  that 
people  relaxed  and  calmed  down  by  interacting 
with  Paro.  The  nursing  staff  observed  that  both 
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groups  of  subjects  were  waiting  for  Paro  and 
participated  with  Paro  willingly.  Paro  increased 
their  laughing,  and  encouraged  the  subjects  to 
communicate  with  each  other  and  the  nursing 
staff.  Moreover,  some  elderly  people  tried  to 
feed  snacks  to  Paro  (Fig. 17).  In  an  interesting 
instance,  an  elderly  woman  who  liked  Paro  very 
much  made  a  song  about  the  baby  seal  and 
sang  it  to  the  robot.  She  looked  very  happy  after 
she  did  this. 

5.  DISCUSSIONS 

We  investigated  the  effects  of  Paro  on  elderly 
people  who  were  staying  in  a  health  service 
facility  for  the  elderly.  Then,  we  compared  the 
effects  of  the  regular  Paro  against  those  of  the 
placebo  Paro.  Contrary  to  our  expectations, 
face  scale  scores  of  both  the  regular  and  pla¬ 
cebo  Paro  groups  improved,  and  their  standard 
scores  of  Depression-Dejection  of  POMS  de¬ 
creased  after  introduction  of  Paro.  This  shows 
that  both  regular  and  placebo  Paro  improved 
elderly  people’s  moods.  Paro  was  especially 
effective  at  alleviating  their  depression. 

Before  the  study,  we  expected  that  people 
would  lose  interest  in  the  placebo  Paro  because 
its  reaction  was  very  simple.  We  were,  however, 
mistaken.  Subjects  of  the  placebo  Paro  group 
kept  interacting  with  their  Paro  and  didn’t  notice 
that  the  placebo  Paro’s  reaction  was  simple. 
Why  didn’t  subjects  lose  interest  in  placebo 
Paro? 

We  consider  the  following  two  reasons: 

(1)  It  was  difficult  for  subjects  to  notice  that 
placebo  Paro’s  reaction  was  one  pattern. 
Subjects  interacted  with  Paro  in  groups  of 
two  or  more  people  at  a  time.  Therefore, 
each  subject’s  interaction  time  with  Paro 
was  not  as  long  for  them  to  notice  that  its 
reaction  was  one  pattern. 

(2)  They  were  not  interested  in  the  mecha¬ 
nism  of  Paro. 

In  general,  elderly  people’s  curiosity  is  lower 
than  that  of  young  people.  Therefore,  they  didn’t 
try  to  investigate  mechanisms  that  made  Paro 
work,  and  didn’t  notice  that  placebo  Paro’s  reac¬ 
tion  was  simple. 


In  this  research,  we  used  the  POMS  question¬ 
naire  because  it  can  measure  six  mood  states 
accurately.  However,  it  had  many  items,  and 
some  subjects  refused  to  answer  them  with  the 
passage  of  time.  We  will  make  more  simple 
questionnaires  to  measure  the  moods  of  elderly 
people  in  future  research. 

6.  CONCLUSIONS 

We  applied  seal-type  mental  commit  robots 
called  Paro  in  robot-assisted  activity  for  elderly 
people  at  a  health  service  facility  for  the  aged. 
The  study  was  carried  out  for  a  total  of  4  weeks. 
Then,  we  compared  the  effects  of  the  regular 
Paro  against  those  of  a  placebo  Paro.  The  re¬ 
sults  show  that  interaction  with  both  the  regular 
and  placebo  Paro  had  positive  psychological 
and  social  effects  on  elderly  people. 

Physiologically,  we  used  urinary  tests  to  objec¬ 
tively  find  that  robot-assisted  activity  decreased 
stress  reaction  in  the  elderly  clients.  The  details 
are  described  in  Saito  et  al  [23].  Now  we  are 
conducting  a  study  that  investigates  the  long¬ 
term  effects  of  interacting  with  Paro  on  the  eld¬ 
erly  people  at  the  same  facility.  The  elderly  peo¬ 
ple  have  been  interacting  with  Paro  for  over  5 
months.  Interaction  with  Paro  has  improved 
their  moods  and  encouraged  them  to  communi¬ 
cate  with  each  other.  Moreover,  they  have 
maintained  an  interest  in  Paro,  and  they  look 
forward  to  seeing  Paro  every  time.  Full  details 
of  this  study  will  be  presented  in  a  later  paper. 
We  plan  to  have  further  studies  and  to  research 
different  conditions  and  situations.  Moreover, 
we  will  investigate  the  relationship  between 
functions  of  a  mental  commit  robot  and  its  ef¬ 
fects  on  elderly  people  in  robot-assisted  activity. 
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Abstract:  Drowsiness  in  drivers  and  pilots  is  a  major  cause  of  injuries  and  accidents.  A  real-time  on¬ 
road  alertness  monitor  is  described  whose  output  is  derived  from  two  laterally  mounted  video  cam¬ 
eras  outside  the  driver’s  field-of-view.  Output  from  the  system  is  a  12-channel  scalar  set  that  meas¬ 
ures  the  frequency  and  duration  characteristics  of  the  driver's  head  position  in  relation  to  a  standard 
driving  position  correlated  behaviorally  with  alertness.  The  two-camera  enhancement  results  in 
greater  accuracy  and  stability  allowing  for  validation  studies  with  other  parameters  of  alertness  that 
are  useful  (such  as  electroencephalography)  but  not  readily  adaptable  to  the  on-road  environment. 
The  processing  methods  described  can  be  implemented  in  an  embedded-processor  configuration 
suitable  for  in-vehicle  deployment. 


INTRODUCTION 

Driver  and  pilot  fatigue,  as  well  as  pilot  impair¬ 
ment  resulting  from  drowsiness  or  environ¬ 
mental  factors  of  incapacitation,  are  major 
sources  of  accidents  and  injuries.  An  approach 
to  continuous,  practical,  noninvasive,  real-time, 
on-board  video  behavioral  monitoring  has  been 
described  by  Steffin  and  Wahl.1  That  method 
provides  the  mechanism  for  extracting  behav¬ 
ioral  corollaries  of  drowsiness  from  salient 
changes  in  feature  complexes  involving  stable 
facial  regions  (fiducials)  including  eyebrow- 
palpebral  fissure  complex  (EPFC),  the  mouth 
region,  and  the  facial  boundaries.  As  a  result  of 
the  video-to-scalar  operation  of  that  approach, 
1 2  scalar  data  channels  are  generated  for  each 
of  the  video  analysis  subregions  (SRs)  in  each 
of  three  major  regions  of  interest  (ROIs),  head, 
EPFC,  and  mouth.  The  method  previously  de¬ 
scribed  was  limited  by  processing  video  data 
from  a  single  centrally  mounted  windshield 
camera.  A  shape  detection  algorithm  that  fil¬ 
tered  video  data  according  to  shape  expecta¬ 
tions  of  the  respective  SRs  resulted  in  12  scalar 
channels  whose  values  were  representative  of 
the  precision  of  alignment  of  the  subject  facial 
features  to  the  standard  facial  position  corre¬ 
lated  with  alertness. 

However,  this  configuration  partially  impaired 
the  driver’s  view,  and  was  less  than  optimally 
sensitive  and  specific.  Improvements  in  the 
technique  include  simultaneous  input  from  two 


laterally  mounted  cameras  that  capture  profile 
facial  views  rather  than  a  frontal  view.  The  re¬ 
sult  is  increased  resolution  of  facial  features 
that  are  relevant  to  drowsiness. 


10  second  sweep! 


Figure  1 :  Schema  for  data  collection  with  two 
cameras.  Outputs  from  laterally  placed  cameras 
are  transferred  to  a  frame  buffer  for  video-to- 
scalar  image  processing.  Levels  of  processing 
include  intensity  discrimination  of  facial  fiducials 
(left  panel)  and  shape  discrimination  (right 
panel).  See  text. 
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Figure  1  shows  the  schema  of  this  approach. 
Real  time  video  from  the  two  cameras  is  trans¬ 
ferred  to  a  frame  buffer  for  analysis.  Two  levels 
of  processing,  intensity  discrimination  (upper 
left  panel)  and  shape  discrimination  (center 
panel),  allow  derivation  of  12  channels  of  data 
corresponding  to  the  alignment  of  the  facial  fi- 
ducials  (eye,  head,  and  mouth)  with  the  stan¬ 
dard,  straight-ahead  position.  Further,  the  pro¬ 
file  schema  generates  comparison  of  the  fidu¬ 
cial  shapes  in  real  time  against  shape  refer¬ 
ences  derived  from  the  actual  face  in  standard 
position,  which  may  be  grabbed  as  the  driver 
first  approaches  cruising  speed.  This  procedure 
enhances  accuracy,  as  compared  to  the  some¬ 
what  arbitrary  shape  discrimination  functions 
employed  in  the  previous  method,  and  will  sim¬ 
plify  calibration  of  the  system  to  the  individual 
driver. 

RESULTS 

Figure  2  demonstrates  the  increased  resolution 
of  facial  fiducials  resulting  from  the  improve¬ 
ments  in  facial  video  acquisition  described.  For 
clarity,  identical  video  input  is  fed  to  both  chan¬ 
nels,  and  analysis  is  performed  on  the  left  chan¬ 


nel.  The  active  scalar  outputs  shown  represent 
the  mouth  and  chin  regions  for  the  left  chan¬ 
nels.  In  A,  there  is  a  clear  downward  deflection, 
with  good  signal-to-noise  level  in  both  active 
channels  representing  changes  in  configuration 
of  the  labial  region  (upper  trace)  and  mental 
region  (lower  trace)  at  the  time  of  mouth  open¬ 
ing.  The  movements  were  on  command,  rather 
than  as  a  result  of  a  natural  yawn,  so  the  deflec¬ 
tions  are  abrupt  and  stable,  and  give  a  good 
estimate  of  the  frequency  response  and  noise 
characteristics  of  the  system.  Similar  deflections 
resulting  from  mouth  closure,  also  on  com¬ 
mand,  are  shown  in  B.  In  C,  a  series  of  open¬ 
ings  and  closings  are  shown  over  a  1 0-second 
sweep. 

Figure  3  shows  a  similar  level  of  resolution  and 
favorable  signal-to-noise  characteristics  for  eye 
blinks,  also,  in  this  instance,  on  command.  The 
upper  channel  records  eyebrow  movement  and 
the  lower  channel  records  the  time  characteris¬ 
tics  of  the  palpebral  fissure.  In  A,  eye  opening  is 
followed  by  eye  closure,  while  in  B  eye  opening 
is  the  final  state,  as  indicated  in  both  the  video 
and  the  scalar  data.  A  series  of  eye  blinks  (on 
command)  is  indicated  in  C. 


Figure  2:  Yawn  detection  as  implemented  with  the  data  collection  method  of  Figure  1 .  A.  Detection 
of  mouth  opening  on  command,  as  shown  in  video.  Upper  active  trace:  scalar  for  labial  region;  lower 
active  trace:  scalar  for  chin  movement.  B.  Detection  of  mouth  closing  as  in  A.  C.  Series  of  openings 
and  closings,  10-second  sweep.  See  text. 


Figure  3:  Detection  of  eye  opening  and  closing  on  command,  with  same  schema  as  Figure  2.  A. 
Initial  eye  opening,  then  closing,  as  shown  in  final  video.  B.  Eye  closing  followed  by  opening,  as 
shown  in  video.  C.  Series  of  eye  blinks  on  command,  10  second  sweep. 
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DISCUSSION 

The  approach  previously  described  (Steffin  and 
Wahl1)  represents  methodology  for  extracting 
behavioral  correlates  of  drowsiness  from  facial 
features  with  practicable  hardware  that  can  be 
reduced  to  a  self-contained  embedded- 
processor  system.  However,  ergonomic  factors 
of  frontal  camera  placement  cause  driver  incon¬ 
venience  and  tend  to  reduce  the  accuracy  of  the 
technique.  The  reliability  of  the  measurements 
with  this  new  configuration  have  increased,  and 
the  intrusion  into  the  driver’s  field-of-view  has 
been  reduced  by  the  dual  camera  monitoring 
techniques  in  the  described  implementation.  As 
a  result,  the  reliability  of  the  technique  appears  to 
be  significantly  increased. 

Future  directions  include  enhanced  compensa¬ 
tion  for  ambient  light  variation.  Initial  considera¬ 
tions  indicate  that  near  infrared  monitoring,  as 
opposed  to  visible  light,  will  provide  further  im¬ 
provements  in  the  stability  of  the  system  in  day¬ 
light  and  will  be  required  for  this  measurement 
system  at  night.  Research  is  in  progress  regard¬ 
ing  the  data  collection  with  limited  infrared. 

It  is  anticipated  that  the  same  attributes  of  effi¬ 
ciency  in  processing  and  coupling  of  system  out¬ 


put  to  relevant  driver  behavior  will  be  realized  in 
the  described  configuration,  so  that  a  reliable 
system  of  drowsiness  detection  independent  of 
ambient  visible  light  will  be  achievable.  Behav¬ 
ioral  studies  are  underway  to  determine  correla¬ 
tion  of  the  scalars  with  more  generalized  meas¬ 
ures  of  performance  (such  as  reaction  time  and 
accuracy  of  obstacle  avoidance)  and  with  elec- 
troencephalographic  monitoring  of  alertness  as  a 
prelude  to  on-road  testing. 
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Abstract:  The  fact  that  driving  performance  gradually  declines  when  individuals  are  driving  a  mo¬ 
notonous  route  for  a  longer  period  of  time  is  well  known.  This  effect  of  decreased  driving  perform¬ 
ance  is  dramatically  amplified  when  subjects  have  experienced  sleep  deprivation  prior  to  the  actual 
driving.  The  overall  consequences  of  these  performance  decrements  have  been  a  major  concern  in 
society.  It  is  widely  accepted  that  fatigue  and  drowsy  driving  account  for  a  large  and  most  probably 
underestimated  number  of  hazardous  accidents.  For  methodological  reasons  the  estimate  of  the 
prevalence  stays  difficult  but  the  use  of  a  virtual  driving  situation  allows  a  promising  method  of  ap¬ 
proach  to  underlying  psychophysiological  mechanisms. 

In  the  present  study  a  real-car  based  static  augmented  reality  driving  simulator  was  used  in  41  subjects 
to  investigate  the  performance  and  the  vigilance  state  of  professional  and  “normal’’  drivers  after  sleep 
deprivation.  To  monitor  vigilance  electroencephalography  (EEG)  was  employed. 


INTRODUCTION 

Drivers  who  are  impaired  due  to  fatigue,  illness 
or  use  of  medication  are  thought  to  have  an  in¬ 
creased  accident  risk.  However,  there  is  no  con¬ 
sensus  in  the  literature  on  the  relation  between 
different  impairments  and  traffic  accidents.  One 
estimates  that  around  30  %  of  all  accidents  have 
driver  impairment  such  as  drowsiness,  alco¬ 
hol/drug  consumption  or  illness  as  a  primary  or 
secondary  cause.  This  problem  is  common 
throughout  Europe  and  accounts  for  15,000  fa¬ 
talities  annually  and  450,000  injuries  in  Europe 
alone.  Whether  a  restrictive  policy  prevents  acci¬ 
dents  remains  controversial  especially  when  con¬ 
clusive  evidence  is  lacking  (e.g.  in  some  coun¬ 
tries  there  is  a  complete  prohibition  of  insulin¬ 
using  drivers  operating  certain  categories  of  vehi¬ 
cles).  It  is  generally  accepted  that  the  ability  of 
disabled  people  to  drive  a  vehicle  considerably 
enhances  their  work  rehabilitation  chances.  Fac¬ 
ing  these  issues,  there  is  a  demand  to  employ 
more  accurate  and  reliable  assessment  method¬ 
ologies  to  evaluate  driving  performance.  It  is  es¬ 
pecially  important  to  investigate  driving  behavior 
of  impaired  drivers  and  to  characterize  typical 


patterns  that  could  indicate  increased  risk  of  an 
accident.  In  the  present  study  the  intervention  of 
a  driver  warning  system  (DWS)  during  driving 
performance  was  used  to  analyse  the  vigilance 
state  in  sleep  deprived  subjects.  Therefore  EEG 
was  conducted  as  widely  accepted  Gold- 
standard  to  monitor  vigilance1.  The  use  of  a  real- 
car  based  static  augmented  reality  driving  simu¬ 
lator  allowed  neurophysiological  access  under 
laboratory  conditions.  The  goal  was  to  define  a 
typical  EEG  response  pattern  (spectral  changes 
after  intervention  of  the  DWS)  indicative  for  sleep 
deprived  subjects. 

MATERIAL  AND  METHODS 

Participants 

The  participants  were  selected  to  cover  various 
types  of  drivers  (passenger  cars)  regarding  driver 
profile,  driving  experience,  and  age.  Before  inclu¬ 
sion  in  the  study,  each  subject  performed  a  test 
drive  in  the  presence  of  a  physician  in  order  to 
identify  kinetosis  sensitive  subjects.  Information 
about  possible  adverse  effects  in  the  driving 
simulator  was  given  before  the  subjects  gave 
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their  informed  consent.  Furthermore,  they  were 
given  instructions  on  how  to  prepare  for  the  ex¬ 
periment:  Partial  sleep  deprivation  during  the 
night  before  the  experiment  (get  up  at  2.00  a.m. 
when  the  experiment  started  at  8.  a.m.),  and 
avoidance  of  coffee,  tea,  or  energy  drinks. 

Experimental  setup 

To  create  realistic  traffic  scenarios  in  a  labora¬ 
tory  environment,  a  passenger  car  simulator 
(deforest  company)  was  used.  The  simulator 
provided: 

•  Computerized  vehicle  emulating  the  com¬ 
plete  functionality  of  a  modern  city  car 

•  PC-based  visual  system  providing  complex 
road  and  traffic  scenarios 

•  PC-based  audio  and  infra-sound  system 

Neurophysiological  measures 

Electroencephalographic  activity  was  continu¬ 
ously  recorded  (bandpass  0.3  -  70  Hz)  from  1 7 
Ag/AgCI  electrodes  using  a  32  channel  cap 
(Easycap)  based  on  the  1 0/  20  system  (F3,  F4, 
C3,  C4,  T3,  T4,  T5,  T6,  P3,  P4,  Fz,  CPz,  Pz, 
A1,  A2,  01,  02).  Data  were  sampled  at  250  Hz 
using  BrainVision  recorder  software  and  a 
Brainamp  amplifier  (Brain  products).  All  elec¬ 
trodes  were  referenced  to  Cz;  for  data  analysis 
they  were  re-referenced  to  the  linked  earlobes 
(A1,  A2).  Horizontal  eye  movements  were  moni¬ 
tored  from  electrodes  placed  lateral  to  the  right 
and  left  eye.  Electrodes  for  the  vertical  axis 


were  placed  above  and  below  the  left  eye.  The 
DWS  actions  “drowsiness  warning"  and  “fatigue 
countermeasures"  were  recorded  along  with  the 
on-going  EEG.  The  acoustic  signal  of  the 
“fatigue  countermeasures”  and  the  confirmation 
reaction  (button-press)  were  stored  for  further 
analysis. 

A  computer  algorithm  was  used  to  attenuate 
eye  artifacts  contaminating  the  EEG  signals2. 
The  algorithm  was  applied  to  all  EEG  traces. 
Additionally  30  sec.  EEG-time  epochs  were 
analysed  and  controlled  for  other  artifacts  (e.g. 
muscular  origin).  The  EEG  signals  were  quanti¬ 
fied  by  use  of  fast  Fourier  transformation.  FFT 
was  calculated  on  the  base  of  2  sec.  segments 
resulting  in  power  values  (pV2)  averaged  for 
each  defined  frequency  band:  theta:  (4  -  7.5 
Hz);  alpha:  (8-12  Hz);  beta  1:  (12  -  18  Hz); 
beta  2:  (18  -  30  Hz).  The  obtained  absolute 
power  values  were  transformed  in  relative 
power  values  based  on  the  frequency  range 
between  4.0  and  32  Hz.  Further  evaluation  of 
spectral  data  followed  two  approaches:  The  nu¬ 
merical  quantification  of  the  “drowsiness  warn¬ 
ing"  intervention  focused  on  the  pre/post¬ 
comparison  of  the  15  sec.  segment  before  the 
drowsiness  warning  with  segments  (15,  30,  60, 
and  120  sec.  duration)  after  the  warning.  These 
segments  were  also  obtained  by  averaging  arti¬ 
fact  free  2  sec.  segments  for  each  frequency 
band  and  segment.  Relative  power  was  chosen 
to  minimize  individual  differences  across  sub¬ 
jects  in  absolute  power  magnitude. 


Figure  1 :  COAT  driving  simulator 
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Figure  2:  Plot  of  alpha  power  values  at  01  pre- 
and  post-  DWS  intervention  (n=41 ;  **  p  <  0.01). 

Statistics 

Data  was  analyzed  using  descriptive  statistical 
methods.  Two-tailed  one-way  between  subjects 
ANOVAs  were  used  to  carry  out  significant  dif¬ 
ferences  between  the  two  age  groups  or  be¬ 
tween  task  conditions  at  every  time  point  of 
measurement.  An  increase  or  decrease  of 
physiological  values  relating  to  baseline  was 
analyzed  using  paired  f-tests. 

RESULTS 

Averaged  relative  power  spectra  in  predefined 
frequency  bands  were  analyzed  pre-  and  post¬ 
intervention  by  the  DWS.  This  approach  was 
chosen  to  evaluate  whether  and  how  long  the 
DWS  under  study  was  able  to  improve  vigilance 
using  EEG  criteria.  Even  if  the  inter-individual 
differences  in  EEG  morphology  are  remarkable, 
the  goal  of  the  approach  was  to  look  for  more 
general  responses  that  exhibit  significance  for 
the  whole  group. 

Alpha  band: 

Fig.  2  gives  the  development  of  the  alpha  power 
for  various  intervals  after  DWS-intervention 
(n=41).  The  example  refers  to  electrode  01  but 
the  illustrated  effect  is  also  true  for  nearly  all 
temporal,  parietal,  and  occipital  leads.  Frontal 
electrodes  did  not  indicate  an  effect  on  alpha 
activity  for  the  whole  group,  but  subgroup  analy¬ 
sis  could  show  a  relevant  change  here.  The 
time  course  of  the  alpha  changes  over  time  is 
illustrated  in  Fig.  3  for  the  whole  group.  It  indi¬ 
cates  that  the  120  sec.  segment  post  warning 
the  effect  is  already  diluted,  and  the  pre-post 
comparison  does  not  reveal  a  significant 
change  any  longer. 


Figure  3:  Fitted  curve  of  pre-post  alpha  power 
(8-1 2  Hz)  changes  over  time  after  DWS  inter¬ 
vention  at  01 .  Note  the  wash  out  of  the  induced 
effect  (n=41;**p<  0.01). 


Beta  band: 

Interestingly  the  beta  2  frequency  band  (power 
values  between  18  and  30  Hz)  was  also  a  very 
consistent  parameter,  changing  in  response  to 
the  DWS-intervention.  As  shown  in  Fig.  4  the 
washout  of  the  beta  2  changes  took  slightly 
more  time  compared  to  the  changes  of  the  al¬ 
pha  frequency  band.  The  effect  was  observed 
at  all  temporal  and  occipital  leads.  Other  frontal 
leads  were  excluded  since  an  overlay  by  arti¬ 
facts  induced  by  muscle  activity  could  not  be 
sufficiently  excluded.  The  quantitative  beta  2 
data  correspond  very  well  with  the  visual  obser¬ 
vations  as  shown  in  Fig.  1  &  2.  The  partially 
high  amplitude  theta  or  alpha  activity  is  ex¬ 
changed  by  a  further  desynchronized  faster  low 
amplitude  beta  activity.  The  analysis  of  the  beta 
1  frequency  band  (12-18  Hz)  does  not  reveal 
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Figure  4:  Development  of  beta  2  power  (18-30 
Hz)  values  after  DWS-intervention  at  01.  Note 
that  there  is  still  a  significant  effect  in  the  1 20 
sec  post-  segment  (n=41  ;**  p  <  0.01 ;  *  p 
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significant  group  effects  (n=36).  One  reason  for 
this  might  be  the  inclusion  of  the  12-14  Hz 
range  that  individually  decreases  after  DWS 
intervention  and  might  compensate  the  effect. 

Theta  band: 

Finally,  the  evaluation  of  the  theta  frequency 
band  was  performed.  Several  subjects  showed 
a  marked  decrease  of  theta  activity  after  DWS- 
intervention.  But  the  theta  effect  in  the  whole 
group  revealed  contrasting  data  (Fig.  5).  There 
was  an  increase  of  theta  power  reaching  a 
maximum  in  the  30  sec  post-DWS  epoch;  after¬ 
ward  a  washout  took  place.  Since  significance 
was  only  reached  over  central  leads  we  think 
that  the  effect  is  probably  not  mediated  by  in¬ 
creasing  artifacts  (no  significant  effects  at 
fronto-temporal  leads).  In  contrast,  we  suggest 
a  theta  generation  that  reflects  the  mental  effort 
to  deal  with  the  situation  and  react  correctly. 


time  intervals  In  sec 


Figure  5:  Theta  power  values  in  various  pre- 
and  post  DWS-intervention  segments.  Note  the 
transient  theta  increase  (C3;  n=41  ;*  p  <  0.05;  (*) 
P  <  0.1) 


DISCUSSION 

In  the  present  study  electroencephalographic 
activity  was  investigated  in  sleep  deprived  sub¬ 
jects  during  performance  in  a  driving  simulator. 
The  use  of  EEG  parameters  is  well  documented 
to  estimate  vigilance  and  awareness  during  mo¬ 
notonous  performance3'5.  For  analysis  two  differ¬ 
ent  approaches  were  chosen.  First,  the  develop¬ 
ment  of  absolute  and  relative  power  spectra  was 
calculated  over  time  using  30  sec.  segments  cov¬ 
ering  the  complete  test  session,  including  base¬ 
line.  Second,  spectral  power  values  were  calcu¬ 
lated  in  respect  to  the  interventions  by  the 


drowsiness  warning.  Within  the  latter  approach 
power  spectra  for  various  time  intervals  between 
15  sec.  and  120  sec.  pre-  and  post-drowsiness 
warnings  were  calculated  and  compared.  Despite 
the  marked  inter-individual  differences  in  EEG 
morphology,  statistical  evaluation  of  the  pre-post 
comparison  revealed  robust  spectral  EEG 
changes  induced  by  the  driver  warning  system 
(DWS): 

Prior  to  the  DWS  intervention  most  of  the  sub¬ 
jects  showed  a  widespread  alpha  baseline  activ¬ 
ity  (8-12  Hz),  which  indicated  drowsiness  since 
eyes  were  opened  during  the  driving  perform¬ 
ance.  Some  of  the  subjects  even  revealed  a  high 
amplitude  anterior  accentuation  of  alpha  activity 
reflecting  a  further  decrease  of  vigilance.  Another 
subgroup  showed  a  dominating  theta  activity  with 
fluctuating  alpha  activity  corresponding  to  sleep 
stage  I.  All  these  groups  consistently  decreased 
in  alpha  power  in  response  to  the  drowsiness 
warning.  There  was  a  remarkable  washout  of  this 
effect  within  a  few  minutes.  Since  the  anterior 
distribution  of  alpha  activity  varied  inter- 
individually  the  most  robust  electrodes  for  the 
described  observation  were  located  at  temporal, 
central,  and  occipital  positions. 

After  baseline  measurement  beta  activity  de¬ 
creased  over  the  course  of  the  driving  perform¬ 
ance  (as  illustrated  by  continuous  spectra) 
reaching  a  low  level  prior  to  the  DWS  interven¬ 
tion.  Thus  the  pre-post  comparison  revealed  a 
marked  beta  increase,  most  consistently  ob¬ 
served  in  the  beta  2  frequency  band  (18-32  Hz). 
Corresponding  to  the  changes  in  the  alpha  ac¬ 
tivity  the  beta  effect  dropped  a  few  minutes  after 
intervention.  The  described  spectral  changes 
were  repeated  individually  several  times  when 
the  drowsiness  warning  was  successively  en¬ 
gaged.  This  supports  the  estimation  of  a  robust 
finding,  even  if  some  subjects  did  not  show  any 
change  in  the  alpha  range.  Interestingly,  the 
expected  changes  in  the  theta  frequency  band 
were  not  consistently  observed.  In  a  subgroup  a 
marked  decrease  was  observed  but  this  effect 
did  not  outlast  in  the  statistical  analysis  regard¬ 
ing  the  whole  group.  In  contrast,  there  was  even 
a  significant  increase  of  theta  activity  (grand 
average)  in  response  to  the  drowsiness  warning 
at  frontal  and  central  leads.  This  paradox  effect 
might  be  partially  due  to  the  increase  of  artifacts 
since  frequently  subjects  start  to  move;  the 
number  of  eye  movements/blinks  are  increased 
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and  might  contaminate  spectra  as  well.  Never¬ 
theless  it  cannot  be  excluded  that  theta  genera¬ 
tion  is  also  part  of  an  arousal  reaction. 

In  summary  the  study  gives  evidence  that  the 
use  of  a  real-car  based  static  augmented  reality 
driving  simulator  is  a  valuable  approach  to  de¬ 
velop  psychophysiological  probes  indicative  for 
drowsiness  during  driving.  In  the  present  report 
the  introduced  electrophysiological  probe  speci¬ 
fies  the  extent  and  the  duration  of  a  DWS  medi¬ 
ated  effect  on  vigilance. 
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ABSTRACT:  Driving  is  an  everyday,  complex  behavior  that  requires  multiple  cognitive  processes 
including  visual  perception,  divided  attention,  and  working  memory.  Schizophrenia  is  a  psychiatric 
disorder  that  often  affects  these  cognitive  processes  critical  to  driving.  We  constructed  a  desktop 
driving  simulator  to  test  how  well  individuals  with  schizophrenia  would  respond  to  a  variety  of  every¬ 
day  driving  situations  relative  to  healthy  participants. 

Patients  and  age-matched  controls  were  confronted  with  a  simulated  2-lane  road  with  traffic  and 
were  instructed  to  obey  all  traffic  laws,  including  the  speed  limit.  After  two  rehearsal  driving  periods  of 
5  minutes,  participants  drove  a  5-minute  experimental  route.  At  the  end  of  the  experimental  drive,  as 
the  subject  approached  an  intersection,  a  car  stopped  at  a  STOP  sign  illegally  entered  the  intersec¬ 
tion,  stopped,  and  blocked  the  driver’s  path.  The  driver  attempted  to  avoid  a  collision. 

Overall  behavioral  measures  included  driving  speed,  stopping  distance,  weaving,  and  near-misses. 
The  results  indicate  that  individuals  with  schizophrenia  made  significantly  more  white  line  errors,  and 
had  a  trend  toward  more  yellow  line  errors  and  collisions.  Additionally,  patients  drove  significantly 
slower  than  control  participants.  This  slow  driving  speed  by  the  patients  could  be  a  byproduct  of  the 
negative  symptoms  or  cognitive  problems  associated  with  the  disease,  or  may  result  from  medica¬ 
tions.  Alternative  explanations  for  this  performance  difference,  such  as  compensating  for  slow  cogni¬ 
tive  processing  or  recruitment  from  other  brain  areas,  are  also  discussed. 


INTRODUCTION 

Driving  is  a  day-to-day  behavior  requiring  multi¬ 
ple  cognitive  processes.  When  driving,  one 
must  be  able  to  perceive  the  environment  accu¬ 
rately  in  order  to  drive  safely.  Also,  a  driver 
must  be  able  to  attend  to  multiple  stimuli.  For 
example,  it  may  be  necessary  to  pay  attention 
to  the  brake  lights  of  cars  in  front  of  the  driver, 
as  well  as  signs  and  other  cars  on  the  road. 
Additionally,  working  memory  is  often  crucial  for 
driving  because  the  driver  must  remember 
street  names  and  goal  locations. 

A  problem  in  psychiatric  illnesses  is  that  im¬ 
paired  functioning  and  driving  skills  are  often 
not  apparent  to  physicians,  family  members,  or 
the  patients  themselves  until  they  are  involved 
in  traffic  accidents2, 5.  Schizophrenia  is  a  psychi¬ 
atric  disorder  that  often  affects  cognitive  proc¬ 
esses  essential  for  driving.  Schizophrenia  typi¬ 
cally  disrupts  the  ability  to  identify  reality,  recall 


situations,  concentrate,  make  judgments,  inter¬ 
act  with  others,  and  think  clearly16. 

Many  studies  indicate  that  schizophrenia  im¬ 
pairs  many  of  the  cognitive  processes  involved 
in  driving6,8,10;  however,  it  is  still  unclear  which 
symptoms  of  the  disease  are  the  most  debilitat¬ 
ing  for  everyday  functioning,  and  how  this  dis¬ 
ease  affects  driving  skills8.  For  example,  it  is 
well  documented  that  patients  with  schizophre¬ 
nia  suffer  from  deficient  working  memory,  di¬ 
vided  attention7,8,  and  have  longer  reaction 
times  than  controls14.  Clearly,  a  quicker  reac¬ 
tion  time  affects  driving,  through  such  necessi¬ 
ties  as  the  ability  to  respond  quickly  if  the  situa¬ 
tion  demands  it.  Individuals  with  schizophrenia 
make  more  errors  on  complex  operations  such 
as  distinguishing  between  figures  and  the 
ground6.  Such  skills  also  seem  critical  for  per¬ 
ceiving  driving  cues  such  as  distinguishing  be¬ 
tween  a  pedestrian  in  the  road  from  a  far-off 
crowd. 
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Because  people  with  schizophrenia  might  be 
predisposed  towards  less  safe  driving  behavior, 
the  link  between  mental  illness  and  driving 
poses  an  important  research  question,  as  the 
majority  of  people  with  schizophrenia  live  and 
may  drive  in  the  community  at  large2.  Prior  re¬ 
search  suggests  that  people  with  schizophrenia 
have  impairments  in  driving.  For  example,  pa¬ 
tients  with  schizophrenia  have  a  significantly 
higher  risk  of  having  an  accident  per  mile5  (two 
times  the  number  of  accidents  as  controls,  per 
mile  driven16).  However,  in  a  separate  study 
using  a  sample  of  mixed  psychiatric  patients, 
researchers  found  no  difference  from  age- 
matched  controls  in  number  of  single  accidents, 
speeding,  or  unsafe  yielding4. 

In  the  current  study,  we  constructed  a  desktop 
driving  simulator  to  test  driving  skills  and  see 
how  an  individual  would  respond  to  everyday 
driving  hazards  (e.g.  children  running  in  front  of 
the  car,  cars  running  red  lights,  a  car  running  a 
stop  sign,  etc.).  We  hypothesized  that  people 
diagnosed  with  schizophrenia  would,  as  a 
group,  display  driving  impairments. 

METHOD 

Participants 

11  individuals  (10  males,  34.9  +  11.2  yrs.  avg. 
age)  with  schizophrenia  or  schizo-affective  dis¬ 
order  and  15  controls  (8  males,  24.1  ±  5.4  yrs. 
avg.  age)  were  tested.  All  participants  had  valid 
drivers’  licenses  and  were  asked  specific  ques¬ 
tions  about  their  driving  behavior;  for  example, 
we  collected  information  relating  to  driving  fre¬ 
quency,  whether  the  individual  restricted  them¬ 
selves  to  only  driving  during  the  daytime,  or  only 
to  familiar  routes.  All  participants  were  paid  $20 
for  their  participation  in  the  study. 

Hardware 

The  simulator  program  was  run  on  a  PC  desk¬ 
top  computer  with  a  1 9"  LCD  Flat  Panel  display. 
A  Logitech  Momo  steering  wheel  with  gas  and 
brake  pedals  served  as  the  input  devices. 

Software 

The  virtual  environment  was  created  and  ren¬ 
dered  with  3D  Game  Studio.  All  World  Definition 
Language  code  and  C-script  code  was  written 


by  the  last  author.  Behavioral  data  of  move¬ 
ment,  trajectories,  speeds,  and  events  through¬ 
out  the  environment  were  analyzed  using  code 
written  in  C  by  Robert  S.  Astur.  Throughout  the 
simulation,  the  participant  was  situated  in  the 
driver’s  seat,  and  a  speedometer  and  tachome¬ 
ter  appeared  on  the  virtual  dashboard. 

PROCEDURE 

Participants  were  placed  on  a  simulated  2-lane 
road  with  traffic  and  were  instructed  to  obey  all 
traffic  laws,  including  the  speed  limit,  which  was 
40  mph  with  a  20  mph  minimum.  Initially,  the 
participant  completed  two  ’warm-up’  runs  of  5 
minutes  each  to  acclimatize  the  driver  to  the 
software  and  hardware.  For  behavioral  meas¬ 
ures,  white  line  errors  were  recorded  when  the 
participant  crossed  the  white  line  on  his/her 
right  side  of  the  road.  White  opposite  line  errors 
were  recorded  when  the  vehicle  traveled  over  to 
the  opposite  lane  and  crossed  its  white  line. 
Additionally,  a  participant  made  a  yellow  line 
error  when  his/her  vehicle  crossed  the  middle 
line.  Collisions  were  also  tallied. 

In  these  rehearsal  runs  the  number  of  white  er¬ 
rors,  white-opposite  errors,  and  yellow  line  er¬ 
rors,  as  well  as  number  of  collisions,  were  dis¬ 
played  on  the  screen.  Each  time  the  vehicle 
crossed  a  line,  a  tone  sounded  to  notify  the  par¬ 
ticipant  that  they  had  made  an  error.  Each  error 
had  a  tone  set  to  a  different  frequency  in  order 
to  help  the  driver  determine  which  error  they 
had  made. 

After  the  warm-up  driving  sessions,  participants 
drove  a  5-minute  experimental  route  on  a  rural 
road  with  other  cars.  At  the  end  of  the  experi¬ 
mental  drive,  the  driver  encountered  a  hazard. 
Specifically,  the  driver  followed  a  lead  car  that 
passed  through  an  intersection  that  had  two 
cars  stopped  perpendicularly  at  stop  signs. 
This  lead  car  established  that  both  the  lead  car 
and  the  driver  had  right-of-way  through  this  in¬ 
tersection.  After  the  lead  car  passed  safely 
through  the  intersection  and  the  driver  ap¬ 
proached  the  intersection,  one  of  the  stopped 
cars  illegally  entered  the  intersection,  stopped, 
and  blocked  the  driver’s  path.  The  driver  was 
forced  to  avoid  a  collision.  Immediately  after 
passing  through  the  intersection,  a  parked  car 
appeared  in  the  driver’s  lane,  and  it  was  again 
necessary  to  avoid  a  collision.  Behavioral  meas- 
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ures  included  driving  speed,  stopping  distance,  tailed.  In  terms  of  collisions,  people  with  schizo- 

weaving  behavior,  near-misses,  and  collisions.  phrenia  were  approximately  three  times  more 

Throughout  all  driving,  car  position  and  speed  likely  to  get  into  an  accident  (an  average  of  0.3 

were  recorded  at  20Hz.  +  0.8  for  controls,  vs.  0.9  +  1.4  for  patients), 

although  this  did  not  reach  significance  (e=.08, 
RESULTS  one-tailed). 

Results  for  driving  errors  in  both  patients  and  In  terms  of  driving  speed,  individuals  with 

controls  are  depicted  in  Figure  2.  In  terms  of  schizophrenia  drove  at  a  significantly  slower 

driving  errors,  individuals  with  schizophrenia  median  speed  than  controls,  t  (24)  =  3.130, 

drove  more  erratically  as  indicated  by  line  er-  £=0.05),  and  at  a  significantly  slower  average 

rors.  Specifically,  patients  committed  signifi-  speed  compared  to  controls,  t  (24)  =  2.523, 

cantly  more  yellow  line  errors  than  controls,  t  p=0.02  (see  Figure  3).  It  is  of  note  that  the  aver- 

(24)  =  -2.46,  p<.05.  Additionally,  individuals  with  age  speed  for  6  of  the  1 1  patients  (54.5%)  was 

schizophrenia  had  significantly  more  white  line  below  the  minimum  posted  speed  of  20mph. 

errors  than  controls,  t  (24)  =  -1 .992,  p<.05,  one- 


Figure  1 :  A  screenshot  of  the  virtual  driving  simulator. 
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DISCUSSION 

In  support  of  our  hypothesis,  we  observed  that 
people  with  schizophrenia  displayed  impair¬ 
ments  on  the  driving  simulator  relative  to  control 
participants.  Specifically,  patients  committed 
significantly  more  white  and  yellow  line  errors, 
and  showed  a  trend  toward  more  collisions. 
This  increase  in  white  line  errors  demonstrated 
that  patients  were  weaving  over  on  the  side  of 
the  road  adjacent  to  the  curb.  The  fact  that  pa¬ 
tients  made  more  yellow  line  errors  is  potentially 
more  disconcerting,  as  these  are  indicative  of 
crossing  over  the  center  of  the  road,  and  such 
errors  may  result  in  swerving  into  oncoming  traf¬ 
fic.  In  addition,  patients  were  approximately 
three  times  more  likely  than  controls  to  get  into 
a  collision. 

The  weaving  errors  are  noteworthy  because  in 
addition  to  making  more  driving  errors,  patients 
also  simultaneously  drove  significantly  slower 
than  the  control  participants.  The  speed  limit 
was  posted  as  40mph,  with  a  20mph  minimum. 
However,  55%  of  the  people  with  schizophrenia 
drove  at  an  average  speed  that  was  below  the 
minimum,  while  0%  of  controls  drove  below  the 
minimum  on  average.  In  sum,  patients  were 
driving  slower  but  still  making  more  errors  than 


control  participants.  People  with  schizophrenia 
clearly  showed  impaired  driving  behavior  on  our 
simulator,  which  suggests  that  patients’  real-life 
driving  may  also  be  impaired. 

It  is  not  apparent  why  people  with  schizophrenia 
make  more  driving  errors  despite  driving  slower 
than  normal  participants.  Schizophrenia  is  diag¬ 
nosed  through  the  presence  of  negative  and 
positive  symptoms,  and  historically  research 
has  focused  more  on  the  positive  symptoms  of 
the  disease  (false  beliefs,  hallucinations,  bizarre 
behavior,  and  disjointed  thoughts)  \  Positive 
symptoms  could  have  an  impact  on  driving 
skills.  For  instance,  someone  who  has  more 
hallucinations  may  have  difficulty  perceiving  the 
driving  environment.  However,  it  has  been  sug¬ 
gested  that  negative  symptoms  (flat  affect,  pov¬ 
erty  of  speech,  loss  of  motivation,  loss  of  pleas¬ 
ure  in  previously  enjoyable  activities,  poverty  of 
thought,  and  impairments  in  attention1)  are  actu¬ 
ally  more  accurate  predictors  of  everyday  func¬ 
tioning78,9.  Thus,  negative  symptoms  may  also 
be  an  indicator  of  a  slower  cognitive  processing 
speed.  It  is  of  note  that  negative  symptoms  and 
cognitive  impairment  have  substantial  overlap 
but  are  not  isomorphic  and  can  be  dissoci¬ 
ated — one  does  not  necessarily  imply  the  other. 


Patient  vs.  Control  Driving  Errors 


Figure  2:  Driving  errors  for  the  two  groups.  Individuals  with  schizophrenia  made  significantly  more 
white  and  yellow  line  errors  and  displayed  a  trend  toward  more  collisions. 
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In  terms  of  driving  speed,  it  may  be  that  the  pa¬ 
tients  are  driving  slower  to  compensate  for  their 
slower  cognitive  processing.  For  example,  they 
might  be  aware  of  their  impairments,  choose  to 
slow  down,  and  allow  more  time  to  respond  to 
objects  in  the  environment.  Thus,  slow  driving 
speed  may  be  a  byproduct  of  the  negative 
symptoms  of  the  disease.  Whereas  it  was  be¬ 
yond  the  scope  of  the  current  experiment  to  cor¬ 
relate  this  symptomology  with  driving  behavior, 
we  plan  to  make  such  correlations  in  future  ex¬ 
periments. 

In  addition  to  exploring  symptoms  of  schizo¬ 
phrenia,  neuropsychological  testing  may  pro¬ 
vide  insight  as  to  why  people  with  schizophrenia 
drive  differently  than  control  participants.  Many 
neuropsychological  tests  assess  cognitive  skills 
essential  for  driving,  and  accordingly,  may  pre¬ 
dict  accident  risk  during  driving.  For  instance, 
the  Trail-Making  Test  15  is  a  timed  visual  se¬ 
quencing  and  speeded  set  alternation  test, 
which  has  been  shown  to  predict  crashes  in 
older  people10.  Additionally,  the  Useful  Field  of 
View  test  (UFOV)  measures  visual  processing 
speed,  selective  attention,  and  divided  atten¬ 
tion11.  The  UFOV  is  particularly  known  to  accu¬ 
rately  and  specifically  identify  drivers  involved  in 


vehicle  crashes,  and  to  predict  car  crashes  in  a 
3-year  follow-up11,12.  Additionally,  visual  percep¬ 
tion  tasks  such  as  the  Motor-Free  Visual  Per¬ 
ception  Test-  Revised  (MVPT-R)3,  test  visual 
memory,  hidden  figures,  and  partial  representa¬ 
tions  have  been  reported  to  predict  accident  risk 
in  elderly  drivers10.  Accordingly,  since  people 
with  schizophrenia  are  often  impaired  in  these 
skills,  neuropsychological  tests  might  provide 
additional  or  complementary  information  to  that 
provided  by  the  driving  simulator. 

Other  issues  to  consider  in  future  driving  studies 
with  this  patient  population  are  driving  experi¬ 
ence,  computer  experience,  and  patients’  medi¬ 
cation.  For  instance,  two  participants  could  both 
describe  themselves  as  driving  ‘frequently’,  but 
one  may  drive  for  long  periods,  while  another 
may  drive  a  few  minutes  a  day  for  only  a  few 
days.  Likewise,  some  participants  may  have 
more  experience  with  computer  and  video 
games,  which  might  give  them  an  advantage  on 
the  simulator.  Additionally,  it  is  not  clear  how  the 
patients’  medications  affect  their  driving  skills: 
These  factors  will  be  included  in  future  projects. 
However,  these  factors  notwithstanding,  it  is 
important  to  remember  that  independent  of 
which  specific  factors  contribute  to  these  driving 


Patient  vs.  Control  Speed 


Max  Speed  Average  Speed  Median  Speed 


Figure  3:  Driving  speed  for  the  two  groups.  Individuals  with  schizophrenia  drove  at  a  significantly 
slower  speed  than  controls. 
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deficits,  individuals  with  schizophrenia  who 
drive  show  driving  impairments  in  this  simulator 
on  a  variety  of  dependent  measures. 

In  this  study,  we  have  demonstrated  a  safe  way 
to  analyze  driving  skills.  Using  our  simulator,  we 
can  program  both  routine  and  hazardous  sce¬ 
narios  and  analyze  driving  performance.  The 
desktop  simulator  may  potentially  identify  an 
impaired  driver  before  that  person  becomes 
hazardous  to  himself  and  others  on  the  road. 
Another  important  research  advantage  of  this 
driving  simulator  is  its  compatibility  with  non- 
invasive  brain  imaging  procedures  such  as 
functional  magnetic  resonance  imaging  (fMRI) 
and  electroencephalography  (EEG).  fMRI  en¬ 
ables  researchers  to  infer  brain  activity  during  a 
task,  while  EEG  allows  clinicians  to  monitor  the 
origin  and  degree  of  electrical  activity  in  the 
brain.  Both  procedures  provide  valuable  data  as 
to  which  parts  of  the  brain  are  being  used  dur¬ 
ing  complex  behaviors  such  as  driving. 

Some  of  our  other  current  projects  involve  ex¬ 
amining  people  with  other  neuropsychiatric  dis¬ 
orders  on  the  driving  simulator.  We  are  studying 
such  disorders  as  strokes,  epilepsy,  Alzheimer’s 
disease,  mild  cognitive  impairment,  and  trau¬ 
matic  brain  injury.  We  are  also  investigating  the 
effects  of  abused  substances  (e.g.  alcohol  and 
marijuana)  on  driving  behavior.  Future  planned 
studies  will  use  this  simulator  for  cognitive  reha¬ 
bilitation  following  traumatic  brain  injury  or 
stroke.  We  have  also  begun  to  use  the  simula¬ 
tor  in  an  fMRI  paradigm  where  we  can  study  the 
neural  systems  involved  in  driving. 

In  summary,  we  created  and  tested  a  viable 
desktop  system  to  test  driving  skills.  The  simu¬ 
lator  is  potentially  usable  with  all  individuals  - 
with  or  without  a  psychiatric  illness.  In  our  pilot 
project  in  individuals  with  schizophrenia,  we 
found  that  patients  displayed  impaired  driving 
skills  relative  to  control  participants.  The  pa¬ 
tients’  difficulties  with  line  errors,  collisions,  and 
maintaining  a  minimum  speed  could  indicate 
real-time  driving  impairments,  which  will  be  a 
focus  of  future  research. 
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A  Clinical  Protocol  for  the  development  of  a  Virtual  Reality  behavioral  training 

in  Disaster  Exposure  and  Relief 
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Abstract:  This  paper  deals  with  the  development  and  evaluation  of  two  different  virtual  reality  cogni¬ 
tive-behavioral  treatment  settings  and  compares  their  effectiveness  in  disaster  preparedness  and 
acute  stress  response  (ASR).  Given  the  extent  of  the  mental  health  problems  following  or  anticipating 
large-scale  natural  or  human  made  disasters,  a  brief,  effective  and  cost-effective  treatment  interven¬ 
tion  is  urgently  needed.  A  common  and  limiting  characteristic  of  the  above  interventions  is  the  fact 
that  they  are  post-disaster  interventions.  That  is  to  say,  beliefs,  attitudes,  and  behaviors  of  interest 
were  assessed  and  treated  after  the  occurrence  of  the  various  disasters.  Consequently,  conclusions 
concerning  the  impact  of  disasters  on  these  types  of  variables  and  even  predisposing  factors  have 
been  largely  based  on  post-hoc  data.  In  the  present  study,  we  are  investigating  predisposing  factors 
that  relate  to  “seismophobia”,  using  a  virtual  reality  setting  and  biopsychobehavioral  correlates.  No 
experimental  research  has  examined  the  hypothesized  factors  related  to  readiness  and  level  of  con¬ 
trol  of  youth  in  real-time  disaster  exposure,  in  order  to  provide  effective  pre-disaster  stress  inocula¬ 
tion  training.  This  study  continued  work  done  in  correlational  studies  and  uses  two  different  virtual 
reality  settings  to  examine  the  role  that  these  settings  play  in  helping  increase  normal  youth  and  sur¬ 
vivors’  problem-  and  emotion-focused  coping.  Children  (n=  209)  were  randomly  assigned,  based  on 
a  school  classroom  from  three  earthquake  sites  in  Greece,  to  a  condition.  The  "plain  emergency  con¬ 
dition"  consisted  of  a  realistic  virtual  earthquake  scenario  program,  occurring  inside  a  school  class¬ 
room  populated  with  behaviorally  realistic,  unfamiliar  faces  on  digital  avatars.  The  "familiar  faces” 
condition  consisted  of  the  usual  condition  combined  with  avatars  using  familiar  co-student  faces. 
Factors  assessed  included  both  problem-  and  emotion-focused  factors:  knowledge  of  mitigation  and 
emergency  response  activities,  school  and  home  hazard  adjustments,  hazard-related  fears,  emotion- 
focused  coping  ability,  and  perceptions  of  co-students'  hazard-related  fears.  Overall,  the  results  sup¬ 
ported  the  role  for  pre-disaster  virtual  reality  programs  in  increasing  resilience  in  youth.  In  particular, 
large  intervention-produced  effect  sizes  were  seen  as  both  normal  children  and  survivors  reported 
hazard  adjustments.  Significant  interactions  provided  additional  support  for  the  role  of  a  familiar  faces 
focus  in  the  problem-focused  areas  of  (1)  both  normal  children  hazard  adjustments  and  (2)  survivors 
increased  preparedness  self-efficacy  and  stress  inoculation.  These  initial  findings  provide  a  continu¬ 
ing  foundation  for  further  research  in  this  emerging  area.  Discussion  considers  the  role  for  such  pro¬ 
grams  in  the  future  and  the  possible  role  of  a  treatment  focusing  on  familiar  faces  in  rapid  recovery 
from  traumatic  stress. 


1.  INTRODUCTION 

Numerous  studies  of  risk  have  attempted  to  iso¬ 
late  factors  related  to  readiness  for  a  future  haz¬ 
ard.  Perceived  personal  consequences  are 
thought  to  relate  to  the  level  of  control  one  has 
over  available  coping  resources  given  the  poten¬ 
tial  for  a  particular  stressful  event.  In  addition  to 
risk  perception1,  two  other  precursor  variables 
are  proposed.  Critical  Awareness  (the  extent  to 
which  people  think  and  talk  about  a  specific  haz¬ 
ard)  is  an  important  precursor2  and  reflects  the 
relative  importance  of  natural  hazards  to  a  per¬ 


son.  Only  when  they  are  perceived  as  salient  or 
critical  will  such  hazards  motivate  protective  be¬ 
havior.  Given  their  destructive  potential,  earth¬ 
quakes  can  represent  a  source  of  anxiety  and 
reduce  the  likelihood  that  people  will  prepare3,4. 
This  is  illustrated  in  Figure  1 .  If  risk  perception, 
critical  awareness  of  hazards,  and  hazard  anxi¬ 
ety  are  present  at  appropriate  levels,  a  person 
will  progress  to  the  next  phase,  forming  inten¬ 
tions  to  adopt.  Progression  between  motivation 
and  intention  formation  is,  however,  influenced 
by  another  set  of  variables  (Figure  1 ). 
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Lazarus  and  Folkman  described  a  model  for  cop¬ 
ing  with  stress  that  delineates  between  problem- 
and  emotion-focused  coping  resources.  Problem- 
focused  resources  are  aimed  at  "doing  some¬ 
thing  to  relieve  the  problem"  and,  in  some  ways, 
"are  similar  to  strategies  used  for  problem  solv¬ 
ing  often  directed  at  defining  the  problem,  gener¬ 
ating  alternative  solutions,  weighting  the  alterna¬ 
tives,  choosing  among  them,  and  acting"5.  Of 
course,  these  strategies  can  be  aimed  both  out¬ 
wardly  (i.e.  the  environment)  as  well  as  inwardly 
(i.e.  the  self)6.  In  terms  of  responding  to  risk  infor¬ 
mation,  problem-focused  resources  would  in¬ 
clude:  factual  knowledge  related  to  readiness 
and  response  behaviors  (i.e.  knowing  what  to  do 
in  the  event  of  a  hazard)  as  well  as  more  per¬ 
formance-  or  behaviorally-based  forms  of  readi¬ 
ness.  In  the  present  context,  this  would  include 
actually  doing  something,  such  as  engaging  in 
risk  reduction  activities.  These  activities,  also 
referred  to  as  hazard  adjustments,  include  efforts 
aimed  at  both  hazard  mitigation  (passive  protec¬ 
tion)  and  emergency  preparedness  (active  re¬ 
sponse)7. 


Emotion-focused  coping  revolves  around  the 
idea  of  emotion  regulation5.  This  form  of  coping 
can  include  emotional  regulation  directly  as  well 
as  strategies  aimed  at  increasing  emotional  regu¬ 
lation.  In  the  former  category,  this  would  include 
reduced  fear  levels  in  relation  to  various  stimuli 
(e.g.  hazards)6.  In  the  latter  category,  one  way  to 
increase  the  potential  for  emotional  regulation  is 
through  adaptive  cognitive  appraisal.  For  exam¬ 
ple,  in  the  current  context,  this  would  include 
one's  appraisal  of  or  confidence  in  the  ability  to 
cope  emotionally  with  a  current  or  future 
stressor,  including  a  hazardous  event8.  An  addi¬ 
tional  factor  here  that  has  been  shown  to  be  sali¬ 
ent  for  children  is  the  perception  of  parental  lev¬ 
els  of  distress  moderating  their  own  fear  levels9. 

As  pointed  out  by  Lazarus  and  Folkman,  each 
form  of  coping  is  usually  involved  in  a  given 
situation,  though  it  may  not  be  able  to  be  identi¬ 
fied  explicitly.  However,  the  two  forms  of  coping 
have  been  demonstrated  to  some  extent  in  risk- 
related  research  with  adult  samples.  For  exam¬ 
ple,  a  lack  of  awareness  and  knowledge,  com¬ 
bined  with  unrealistic  risk  perceptions,  have  been 
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shown  to  have  a  negative  impact  on  prepared¬ 
ness  and  responses  to  warnings10'12.  Recently, 
Sjoberg  has  pointed  out  that  such  factors  (e.g. 
unrealistic  risk  perceptions)  may  be  exacerbated 
by  hazard-related  fears13. 

In  terms  of  child  samples,  previous  research  with 
400  children  and  young  adolescents  in  school 
settings  found  relationships  between  problem- 
focused  and  emotion-focused  factors8.  For  ex¬ 
ample,  this  study  found,  like  Sjoberg's,  that  chil¬ 
dren  demonstrating  unrealistic  risk  perceptions 
(i.e.  those  perceiving  low-frequency  events  at  a 
high  rate)  also  had  much  greater  frequencies  of 
hazard-related  fears  (by  a  factor  of  more  than  2), 
and  lower  levels  of  confidence  in  their  ability  to 
cope  emotionally  with  a  future  hazard  as  com¬ 
pared  to  children  with  more  realistic  risk  percep¬ 
tions.  In  addition,  the  fearful  group  of  youth  also 
demonstrated  consistently  lower  levels  of  knowl¬ 
edge  about  emergency  response  compared  to 
less  fearful  children.  These  findings  underscore 
the  potential  value  of  addressing  both  problem- 
and  emotion-focused  factors  in  research  and 
applied  settings. 

Given  such  findings,  it  comes  as  no  surprise 
that  children  who  demonstrated  more  realistic 
risk  perceptions/more  knowledge/less  fear  had 
been  exposed  to  hazards  whereas  their  coun¬ 
terparts,  who  had  decreased  knowl¬ 
edge/unrealistic  risk  perceptions/increased  fear 
had  not  been14.  In  addition,  children  involved  in 
disasters  reported  increased  perceptions  of  be¬ 
ing  hurt  physically  in  the  event  of  a  range  of 
hazards  compared  to  children  not  involved. 
However,  these  same  children,  when  compared 
with  those  children  not  involved  in  disasters, 
also  reported  a  lower  frequency  of  hazard- 
related  fears  (12%  versus  28%,  respectively, 
reported  feeling  often  scared)  as  well  as  lower 
levels  of  perceived  fears  in  their  parents  (9% 
versus  22%,  respectively).  Further,  the  more 
children  were  involved  in  disasters  (i.e.  two  or 
more  disasters),  the  more  they  derived  bene¬ 
fits15. 

Critical  awareness,  risk  perception  and  anxiety 
predict  outcome  expectancy.  The  role  of  anxiety 
was  more  complex  than  anticipated.  Possibly 
the  most  interesting  relation  is  the  finding  that 
'intentions'  comprise  two  variables:  ‘Intention  to 
Prepare’  and  ‘Intention  to  Seek  Information’16. 
Critical  awareness  demonstrated  direct  and  in¬ 


direct  relationships  with  both  'Intention  to  Pre¬ 
pare’  and  ‘Intention  to  Seek  Information’,  reiter¬ 
ating  the  relative  importance  of  critical  aware¬ 
ness  as  a  motivating  factor.  The  general  find¬ 
ings  are  that  children's  reactions  to  hazards  are 
based  on  a  combination  of  factors  that  include 
(1)  direct  exposure  to  the  hazard  combined  with 
the  perception  of  increased  physical  risk,  (2) 
pre-existing  characteristics  (e.g.  demographic 
factors  including  medical  factors,  age,  gender, 
ethnicity;  pre-existing  emotional  problems),  (3) 
availability  of  adaptive  coping  ability  and  re¬ 
sources,  (4)  access  to  social  and  family  support, 
and  (5)  the  occurrence  of  major  life  stressors 
(e.g.  parental  divorce,  family  death)  following 
the  hazard7'9. 

One  stressor  for  children  appears  to  be  percep¬ 
tions  of  co-students  distress.  That  is,  research 
following  a  hazard  has  found  that  those  children 
perceiving  greater  levels  of  co-students  distress 
were  also  seen  to  cope  less  effectively  in  the 
aftermath  of  a  hazard8.  The  implication  here  is 
that  the  perception  of  decreased  co-students 
upset  in  relation  to  hazards  has  benefits  for 
youth.  This  study  is  attempting  to  model  all  of 
the  above  factors  into  a  virtual  reality  scenario 
and  propose  a  generic  hazard  preparedness 
and  relief  clinical  protocol  tailored  to  individual 
children  profiles. 

2.  DESIGN 

2.1 .  Overview  of  the  Design 

The  current  research  was  designed  to  provide 
information  concerning  various  aspects  of  emo¬ 
tion-  and  problem-focused  coping  in  a  sample  of 
Greek  school  children.  The  following  areas  were 
assessed:  emotional  factors  (level  of  hazard- 
related  upset  in  children  and  perceived  emo¬ 
tional  coping  ability)  as  well  as  children's  knowl¬ 
edge  of  hazard  mitigation  and  emergency  re¬ 
sponse  behaviours.  In  addition,  an  assessment 
of  a  variety  of  hazard  adjustments  was  made 
based  on  both  child  and  parent  report. 

The  design  was  quasi-experimental17  with  a 
control  group.  That  is,  it  was  a  pre-test/post-test 
control  group  design.  It  was  quasi-experimental 
in  that  it  involved  administration  of  the  inde¬ 
pendent  variable  (i.e.  the  two  different  versions 
of  the  virtual  reality  scenario)  to  intact  groups. 
Two  groups  and  a  control  were  involved.  The 


125 


first  was  designated  "Emergency  Condition" 
(EC)  and  consisted  of  a  virtual  earthquake  sce¬ 
nario  inside  a  school  classroom  in  the  middle  of 
a  class,  populated  with  full  body  behaviorally 
realistic  avatars.  The  second  condition  involved 
EC  supplemented  with  avatars  digitized  with 
explicit  photorealistic  faces  resembling  the  ones 
of  the  usual  co-students  of  the  school  children. 
The  groups  were  mixed  with  children  that  had 
experienced  a  medium  earthquake  before  and 
children  that  had  not.  In  this  study,  four  class¬ 
rooms  from  three  different  regions  of  the  coun¬ 
try  were  assigned  to  the  EC  Condition  (n=  104), 
and  four  classrooms  to  the  familiar  faces,  FF 
Condition  (n=  105).  Participants  were  from  inter¬ 
mediate  schools.  Of  the  209  total  participants, 
95  were  female,  86  were  male.  The  ages  of  the 
children  ranged  from  11  to  1 3  years  (mean  age 
=  1 1 .8;  SD=  0.45;  modal  age  =  1 2). 

The  virtual  environment  was  constructed  using 
a  combination  of  tools  including  the  WorldTool- 
kit  R6  from  Sense8,  the  Dl-Guy  scenario  from 
Boston  Dynamics  and  the  proFACE  face  model¬ 
ling  software  from  Famous3D.  The  hardware 
included  an  SGI  dual  processor  platform,  an 
lnterTrax2  (serial)  head  tracker  and  the  i-visor 
DH-4400VPD  (stereo)  head  mounted  display. 
The  overall  performance  of  the  system  was  in 
real-time  (35fps)  We  also  measured  the  biopsy- 
chobehavioral  corollaries  in  real  time  with  a  Vi¬ 
enna  Test  System  to  associate  the  children’s 
psychosocial  and  physiological  responses. 

2.2.  Measures 

Measures  included  self-report  indices,  the  vir¬ 
tual  scenario,  and  a  home-based  instrument 
filled  out  by  parents  after  the  treatment. 

2.2.1.  Self-Report  General  Self-efficacy 
measures 

Participants  completed  a  questionnaire  that  in¬ 
cluded  both  problem-  and  emotion-focused  fac¬ 
tors  across  a  range  of  hazards  and  mass  emer¬ 
gencies:  floods,  storms  with  high  winds  (e.g. 
cyclones),  fires,  earthquakes,  volcanic  erup¬ 
tions,  tsunamis,  and  chemical  spills/gas  leaks. 
Items  intended  to  reflect  problem-focused  cop¬ 
ing  were  assessed  in  three  ways  (child’s  knowl¬ 
edge  about  mitigation  and  response;  child- 
reported  hazard  adjustments;  parent-reported 
hazard  adjustments).  The  items  themselves 


were  gathered  from  both  emergency  manage¬ 
ment/civil  defence  recommendations  as  well  as 
previous  research  on  hazard  adjustments18. 
Other  items  were  intended  to  reflect  the  youth’s 
emotion-focused  coping  in  three  areas  (hazard- 
related  fear  levels,  perceptions  of  other's  haz¬ 
ard-related  distress,  and  perceptions  of  ability  to 
cope  emotionally  with  a  future  hazard).  Each  of 
these  items,  developed  from  previous  re¬ 
search24,  has  been  linked  to  meaningful  findings 
(e.g.  with  problem-focused  coping;  with  reduc¬ 
tions  in  problems  following  a  hazard;  respon¬ 
siveness  to  intervention)  as  documented  earlier: 
(1)  prior  to  a  hazard's  occurrence  as  well  as  (2) 
in  the  aftermath  of  a  hazard.  Anxiety  before  and 
after  the  scenario  was  correlated  with  biopsy- 
chobehavioral  during  the  scenario,  using  the 
State-Trait  Anxiety  Inventory  (STAI)  and  the 
Vienna  Test  System. 

We  now  provide  an  overview  of  each  section  of 
the  virtual  scenario.  The  following  areas  were 
assessed  in  addition  to  the  data  reported  earlier 
with  the  questionnaire. 

2.2.1. 1.  Problem-focused  coping:  Knowledge 
mitigation  and  response  behaviours 

Children  were  instructed  that  more  than  one 
item  could  be  endorsed  if  it  represented  an  ap¬ 
propriate  response  to  that  hazard.  These  items 
were  adopted  from  those  highlighted  in  Greek 
hazard  education  programs  as  well  as  emer¬ 
gency  management  brochures.  The  alpha  reli¬ 
ability  of  these  items  using  a  larger  sample  ( n= 
548)  from  previous  research  was  found  to  be 
0.85. 

2.2. 1.2.  Problem-focused  coping:  Hazard 
adjustments 

Children  were  asked  to  follow  the  Drop,  Cover 
and  Hold  drill  adjustments,  inside  a  virtual  set¬ 
ting.  The  23  specific  adjustments  included  tak¬ 
ing  cover,  storing  hazardous  materials  safely, 
adding  lips  to  shelves,  having  a  fire  extin¬ 
guisher,  having  a  smoke  detector,  storing  emer¬ 
gency  equipment,  picking  a  contact  person, 
learning  how  to  administer  first  aid,  finding  out 
which  hazards  are  more  likely  in  their  area,  and 
having  the  school  inspected  for  resistance  to 
earthquakes.  The  alpha  reliability  here  based  on 
a  larger  sample  (n=  557)  used  in  previous  re¬ 
search  was  found  to  be  0.92. 
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2.2. 1.3.  Emotion-focused  coping  factors 

The  items  were  as  follows:  (1)  the  child's  level 
of  overall  fear  or  upset  when  encountering  vir¬ 
tual  hazards  (1  =  not  at  all,  2  =  sometimes,  3  = 
often),  (2)  the  child's  perceptions  of  any  co¬ 
student’s  upset  when  discussing  hazards  (1  = 
yes,  2  =  not  sure,  3  =  no).  These  items  were 
taken  from  a  10-item  scale  used  in  previous 
research  that  also  assessed  fears  for  eight  spe¬ 
cific  hazards.  The  alpha  reliability  of  that  10- 
item  measure  based  on  a  larger  sample  (n= 
405)  was  found  to  be  0.76.  These  two  items 
were  chosen  for  this  research  because  they 
produced  the  most  meaningful  findings  as  re¬ 
viewed  earlier.  A  final  item  here  was  the  child's 
perception  of  the  ability  to  cope  emotionally  in 
the  event  of  a  hazard  (1  =  not  at  all  able,  to  7  = 
completely  able  to  "to  help  self  feel  comfort¬ 
able/less  upset").  This  was  a  stand-alone  item 
that  was  based  on  previous  research  reviewed 
earlier.  A  previous  three-item  version  used  in 
research  following  a  hazard  ( n=  118)  reported 
an  alpha  of  0.71. 

2.2.2.  Home-Based  Child  Preparedness 
Questionnaire 

This  questionnaire  asked,  like  the  Mulilis-Lippa 
Preparedness  Scale3,  for  the  capability  in  cop¬ 
ing  with  the  disruption  associated  with  hazard 
activity.  It  was  included,  like  the  other  meas¬ 
ures,  both  before  and  after  the  virtual  earth¬ 
quake  distress  programs  to  assess  intervention 
effectiveness.  It  also  was  included  to  provide  a 
validity  check  of  child  reports.  Our  previous  re¬ 
search  assessed  the  correlation  between  child 
and  significant  other’s  report  to  be  r=  0.30,  p< 
0.01.  The  alpha  reliability  of  the  measure  based 
on  a  larger  sample  (n=  280)  used  in  that  previ¬ 
ous  research  was  found  to  be  0.77. 

2.3.  Procedure 

The  study  was  administered  at  pre-,  during,  and 
post-intervention  within  each  of  the  schools  by  a 
trained  doctoral-level  child  researcher  (senior 
author)  with  the  assistance  of  classroom  teach¬ 
ers.  Children  were  able  to  fill  out  questionnaires 
by  reading  to  themselves  after  the  instructions 
were  read  aloud  to  them.  Children  were  then 
encouraged  to  enter  the  virtual  scenario  indi¬ 
vidually.  Total  time  necessary  to  administer  the 
scenario  was  approximately  5-6  minutes.  As 


part  of  a  post  intervention  homework  exercise, 
children  were  asked  to  take  a  home-based 
questionnaire  to  their  parents/guardians  to  have 
it  filled  out  and  returned. 

2.3.1.  Emergency  condition  (EC) 

This  condition  involved  a  Virtual  Reality  Envi¬ 
ronment  (VRE)  around  an  existing  Greek  class¬ 
room  of  a  school  interior  and  part  of  the  exterior. 
The  VRML  model  of  the  school  was  photorealis¬ 
tic  and  imported  directly,  as  a  scale  and  layout 
reference.  The  classroom  was  populated  with 
1 2  students  and  a  teacher,  each  capable  of  re¬ 
alistic  emotive  responses  to  an  earthquake 
situation,  such  as  show  fear,  communicate  dis¬ 
tress  to  varying  degrees,  move  around  the 
classroom.  We  provided  two  basic  modes  of 
interaction  -  a  guided  “storytelling”  mode  and 
an  interactive  mode,  where  the  participant  con¬ 
trols  his  or  her  navigation/actions  in  a  simulated 
earthquake.  When  an  earthquake  event  is  trig¬ 
gered,  avatars  respond  appropriately,  items  in 
the  VE  respond  with  some  degree  of  physics, 
and  the  environment  shakes  along  with  the  ap¬ 
propriate  sound  effects.  The  participant  must 
evacuate  the  classroom  and  go  to  an  exterior 
area,  with  visible  and  audible  navigation  cues  if 
they  deviate  from  the  optimal  path.  The  soft¬ 
ware  was  integrated  with  an  lnterTrax12  tracker 
and  the  researcher  was  using  an  interface 
(Vienna  Test  System)  that  allowed  him  to  ob¬ 
serve  the  participant's  actions  and  biopsychobe- 
havioral  corollaries  as  he  navigated  through  the 
VRE  during  the  exercise. 

2.3.2.  Familiar  Faces  (FF)  condition 

This  condition  involved  the  EC  plus  a  realistic 
representation  of  the  co-students'  faces,  en¬ 
hanced  with  emotional  reactions  in  real-time. 
This  focused  on  emotional  factors  and  inten¬ 
tions  to  seek  information  explicitly;  it  was 
thought  that  a  focus  on  the  social  self-image, 
psychological  preparation  and  related  fears 
would  increase  a  sense  of  control  and  conse¬ 
quently  benefit  emotional  factors. 

2.4.  Plan  of  Analysis,  Assumption  Checking, 
and  Intervention  Fidelity 

Prior  to  assessing  intervention  effectiveness, 
differences  between  groups  on  each  dependent 
variable  were  assessed.  Given  our  focus  on 
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outcome  analysis,  intervention  effectiveness 
was  assessed  through  a  2x2  split  plot  repeated 
measures  analyses  of  variance  (ANOVA).  All 
necessary  assumptions  (homogeneity  of  vari¬ 
ance,  sphericity,  homogeneity  of  covariance 
matrices,  or  intercorrelations)  were  met  for 
these  analyses  with  one  exception.  That  is,  the 
homogeneity  of  variance  assumption  was  mildly 
violated  between  groups  for  pre-test  fear  scores 
(Levene's  test,  F(  1,  138)  =  5.38,  p<  0.03).  Vari¬ 
ous  transformations  (logarithmic,  square, 
square  root,  reciprocal,  arcsine)  did  not  improve 
the  homogeneity  of  variance  estimate.  How¬ 
ever,  given  similarly  shaped  distributions,  the 
variances  being  no  more  than  four  times  differ¬ 
ent  from  each  other  (different  by  a  factor  of  1 .3), 
and  nearly  equal  sample  sizes  (difference  of 
only  six  participants  per  cell  in  this  analysis),  the 
ANOVA  procedure  is  generally  robust  under 
these  conditions18.  However,  as  an  additional 
confirmation,  an  independent  samples  Mest 
was  carried  out  on  pre/post  change  scores 
(and,  for  the  trials  effect,  a  paired  Mest  for 
pre/post  scores).  Here,  the  homogeneity  of  vari¬ 
ance  assumption  was  met  (F(1,  138)  <  1),  and 
the  findings  reflected  the  same  statistics  (when  t 
scores  were  compared  with  Ftest  scores  based 
on  F  statistic,  figures  were  within  0.007  of  each 
other  for  between  group  and  within  0.0004  for 
within  group)  and  pattern  of  significance  (within 
0.001  of  each  other).  Therefore,  ANOVA  find¬ 
ings  were  retained  and  are  reported  in  Results. 

Analysis  of  covariance  (ANCOVA)  and  other 
forms  of  statistical  control  (e.g.  hierarchical  lin¬ 
ear  modelling  (HLM))  were  considered.  How¬ 
ever,  in  addition  to  the  assumptions  for  ANOVA, 
ANCOVA  requires  the  assumption  of  homoge¬ 
neity  of  regression.  In  fact,  this  assumption  is 
quite  critical  and,  if  not  met,  has  been  shown  to 
lead  to  "misleading  analyses”  in  relation  to  edu¬ 
cation  programs1  .  In  inspecting  the  scatter 
plots  (using  pre-treatment  scores  as  covariates) 
regression  lines  were  not  uniformly  similar  in 
slope  across  parameters,  thus  making  results 
from  ANCOVA  potentially  suspect.  However,  as 
an  exploratory  device,  ANCOVA  was  carried  out 
and  results  were  uniformly  equivalent  to  those 
reported  from  ANOVA  in  Results  (i.e.  same  pat¬ 
tern  of  significance).  In  terms  of  effect  size  (ES) 
comparisons,  generally  they  were  quite  similar. 
However,  when  they  differed,  the  ES  estimated 
from  the  ANOVA  was  always  more  conservative 
than  that  from  the  ANCOVA. 


In  terms  of  HLM  analyses,  while  children  were 
nested  within  the  classroom,  given  that  the  unit 
of  generalization  here  was  the  individual  child20, 
the  decision  was  made  a  priori  (i.e.  prior  to  the 
study  commencing)  to  consider  the  classrooms 
within  treatment  condition  as  equivalent.  This 
decision  follows  the  convention,  particularly  in 
treatment  outcome  research  in  evaluating  the 
initial  effectiveness  of  an  intervention21,  which 
uses  as  the  basic  unit  of  analysis  the  individual 
child.  This  is  done  despite  the  fact  that  in  such 
studies  typically  each  child  is  assigned  to  a  dif¬ 
ferent  therapist  (equivalent  to  the 
teacher/classroom  here)  within  a  particular  in¬ 
tervention  condition.  The  rationale  for  such  a 
decision  relates  to  the  idea  of  intervention  fidel¬ 
ity  (i.e.  equivalence  in  producing  the  named  in¬ 
dependent  variable  despite  some  individual 
variation  on  other  factors).  Given  that  we  had 
confirmation  from  each  teacher  (and  as  a  valid¬ 
ity  check,  their  overall  supervisors  for  this  pro¬ 
ject,  the  vice-principal  and  lead  teacher)  that  the 
protocols  described  earlier  followed  improved 
confidence  in  using  the  more  basic  repeated 
measures  analysis.  Additionally,  in  terms  of  a 
rationale  for  HLM,  we  had,  as  recommended22, 
no  a  priori  data  collected  (e.g.  teacher  compe¬ 
tence,  systematic  student  differences  by  class¬ 
room)  that  spoke  to  what  might  underlie  variabil¬ 
ity  among  the  classrooms  if  an  HLM  procedure 
uncovered  differences.  Related  to  this  idea, 
moderating  or  mediating  influences  were  not 
considered  as  a  primary  focus  of  this  study.  Fi¬ 
nally,  recent  recommendations  regarding  HLM 
have  suggested  a  minimum  number  of  groups 
necessary  for  valid  HLM  analyses  to  be  much 
greater  (e.g.,  30-100)  than  the  number  of  class¬ 
rooms  involved  in  this  study  (i.e.  eight). 

However,  to  provide  a  preliminary  assessment 
of  relationships  between  variables  in  the  study, 
included  is  a  zero-order  correlation  matrix.  The 
variables  in  the  correlation  analysis  not  only 
included  dependent  (problem-  and  emotion- 
focused  factors,  pre-,  post-,  and  change  scores) 
and  independent  (intervention  condition  dummy 
coded)  variables,  but  also  other  factors  that 
were  assessed,  including  age,  sex,  previous 
disaster  experience,  and  classroom. 

In  the  repeated  measures  analyses,  both  prob¬ 
lem-focused  factors  (child-  and  survivors- 
reported  hazard  adjustments;  child  hazard 
knowledge)  and  emotion-focused  factors  (fear, 
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relaxed  effect  that  comes  as  a  result  of  stroking 
a  dog  for  a  long  time  is  not  felt  when  interacting 
with  AIBO. 

In  this  paper,  we  used  seal  robots  to  assist  the 
activity  of  elderly  people  at  a  health  service  fa¬ 
cility  for  the  aged  in  order  to  Investigate  the  psy¬ 
chological  and  social  effects  of  the  seal  robots 
on  the  elderly  people  who  stayed  at  the  facility. 
We  also  compared  the  effects  of  the  seal  robot 
and  those  of  a  placebo  seal  robot  that  had  a 
less  active  motion  generation  program. 


Paro  has  a  behavior  generation  system  that 
consists  of  two  hierarchical  layers  of  process¬ 
ing:  proactive  and  reactive  processes  (Figure 
9).  These  two  layers  generate  three  kinds  of 
behaviors:  proactive,  reactive,  and  physiological 
behaviors. 

(1)  Proactive  Behaviors:  Paro  has  two  layers 
to  generate  its  proactive  behaviors:  a  behavior¬ 
planning  layer  and  a  behavior-generation  layer. 
Considering  internal  states,  stimuli,  desires,  and 
a  rhythm,  Paro  generates  proactive  behaviors. 


SEAL  ROBOT  AND  PLACEBO  SEAL  ROBOT 

Specifications  of  Seal  Robot 

A  seal  robot,  Paro,  was  developed  for  physical 
interaction  with  human  beings  (Figure  4).  Paro 
looks  like  a  baby  harp  seal,  which  has  white  fur 
for  three  weeks  after  its  birth.  As  for  perception, 
Paro  has  tactile,  visual,  auditory,  and  postur-e 
sensors  beneath  its  artificial  soft,  white  fur.  In 
order  for  Paro  to  have  a  soft  body,  a  tactile  sen¬ 
sor  was  developed  and  implemented.  As  for 
action,  Paro  has  seven  actuators:  two  for  each 
eyelid,  two  for  the  neck,  one  for  each  front  fin, 
and  one  for  the  two  rear  fins.  Paro  weighs  about 
3.0  kg. 


(a)  Behavior  planning  layer  This  has  a 
state  transition  network  based  on  internal 
states  of  Paro  and  Paro’s  desire  produced  by 
its  internal  rhythm.  Paro  has  internal  states 
that  can  be  named  with  words  of  emotions. 
Each  state  has  a  numerical  level  and  is 
changed  by  stimulation.  The  state  decays  with 
time.  Interaction  changes  its  internal  states 
and  creates  Paro's  character.  The  behavior- 
planning  layer  sends  basic  behavioral  pat¬ 
terns  to  behavior-generation  layer.  The  basic 
behavioral  patterns  include  some  poses  and 
some  motions.  Here,  although  “proactive"  is 
referred,  Paro's  proactive  behaviors  are  very 
primitive  compared  with  those  of  human  be¬ 
ings.  We  implemented  behaviors  similar  to 
that  of  a  real  seal  In  Paro. 


Stunalatiocn 
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Posture 


Proactive  Processes 


Basic  Behavior 
Pattern  1 


Basic  Behavior 
Pattern  n 
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Reactive  Processes 


Figure  9.  Paro’s  behavior  generation  system. 
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focused  variables:  (1)  emotion-based  hazard 
adjustments  as  reported  by  both  children  and 
survivors  and  (2)  fear-related  cope.  These  find¬ 
ings  support  previous  corollary  research3,10  and 
provide  the  first  experimental  evidence  of  the 
benefits  of  such  programs  prior  to  a  hazardous 
event.  It  also  follows  similar  research  supporting 
the  effectiveness  of  school-based  intervention 
following  a  natural  hazard24. 

Compared  to  the  EC  virtual  scenario  program, 
the  FF  Condition  was  seen  to  produce  greater 
benefits  in  the  areas  targeted  (i.e.  problem- 
focused  areas)  and  the  emotion-focused  area 
(i.e.  hazard  fears,  perception  of  parental  fears, 
emotional  coping).  What  makes  this  finding  par¬ 
ticularly  encouraging  is  that  previous  research 
following  a  disaster  has  found  that  those  chil¬ 
dren  coping  less  effectively  perceived  signifi¬ 
cantly  greater  levels  of  co-students  distress25. 
The  implication  here,  supported  by  additional 
corollary  findings  discussed  below,  is  that  the 
perception  of  decreased  co-students  upset 
likely  has  benefits  for  many  children.  In  addition, 
the  fact  that  these  virtual  programs  were  seen 
to  produce  a  decreased  sense  of  distress  bodes 
well  for  these  children  being  able  to  manage  a 
future  event  more  effectively. 

While  the  FF  Condition  outperformed  the  EC 
Condition  in  the  emotion-focused  areas,  the  EC 
Condition  nonetheless  produced  benefits  as 
indicated  by  the  large  trials  effects  and  related 
effect  sizes,  particularly  in  the  area  of  both 
child-  and  survivors  problem-focused  reported 
hazard  adjustments.  Those  findings  here  sup¬ 
port  our  previous  corollary  research24  and  pro¬ 
vide  additional  evidence  supporting  the  general 
idea  of  increasing  any  children's  exposure  to 
hazards  and  disasters  in  educational  settings. 

In  terms  of  relationships  between  variables  in 
the  study,  a  few  are  worth  highlighting.  First, 
there  were  no  robust  relationships  seen  be¬ 
tween  problem-  and  emotion-focused  factors. 
However,  there  were  relationships  seen  involv¬ 
ing  variables  within  a  given  domain  (i.e.  prob¬ 
lem-  or  emotion-focused  domains).  In  particular, 
problem-focused  factors  tended  to  relate  to 
each  other.  For  example,  child  factual  knowl¬ 
edge  was  seen  to  relate  to  both  child-  and  survi¬ 
vor-reported  hazard  adjustments.  Fewer  sys¬ 
tematic  relationships  were  seen  within  the  emo¬ 
tion-focused  domain.  However,  children's  per¬ 
ception  of  co-student  upset  was  seen  to  predict 


their  own  level  of  fear,  measured  with  the  Vi¬ 
enna  Test  System.  The  finding  here  provides 
some  further  support  for  the  idea  suggested 
earlier  that  children's  perceptions  of  co¬ 
students'  feelings  affect  their  own  fear  levels. 

Given  that  youth  necessarily  rely  on  adults  or 
co-students  for  coping  with  problems,  virtual 
adults'  or  co-students’  willingness  to  react  on 
such  events  may  serve  to  help  reassure  chil¬ 
dren  as  well  as  provide  them  with  a  "coping 
model"24.  Cognitive  behaviour  therapy  is  re¬ 
garded  as  a  brief  form  of  psychotherapy,  but  it 
may  not  be  brief  enough  in  post  disaster  cogni¬ 
tive  behaviour  therapy  settings,  where  hundreds 
of  thousands  of  survivors  may  need  urgent 
care.  The  virtual  scenario  modified  with  familiar 
faces  presented  here  appears  to  be  promising 
as  an  effective  one-  or  two-session  intervention 
for  earthquake  preparedness  and  survivors.  It 
may  be  particularly  useful  in  large-scale  disas¬ 
ters  as  a  cost-effective  treatment  that  can  be 
relatively  easily  disseminated  to  the  masses. 

Nonetheless,  future  research  might  include  an 
after  an  earthquake  condition  to  emphasize  in¬ 
ternal  validity.  Additionally,  this  study  focused 
on  short-term  effects  of  virtual  reality  programs: 
future  efforts  might  include  follow-up  assess¬ 
ments  over  a  longer  interval  to  assess  whether 
changes  are  generalized  across  time.  Finally, 
additional,  a  priori  emphasis  on  specific  nesting 
factors  (e.g.  schools,  classrooms,  families,  inter¬ 
vention  condition)  and,  related,  potential  media¬ 
tors  and  moderators  of  change  (e.g.  demo¬ 
graphic  factors,  child  and  family  pre-intervention 
expectancies,  teacher  competence  at  program 
delivery)  would  begin  to  build  on  the  initial  foun¬ 
dation  provided  here. 
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EC  Condition 

FF  Condition 

ANOVA  Summary 

Hazard  Adjustments:  Child 

Pre 

5.83  (5.28) 

7.00  (5.60) 

a,  b 

Post 

11.23  (6.10) 

10.07  (6.50) 

Hazard  Adjustments:  Survivor 

Pre 

10.25  (3.96) 

9.94  (3.94) 

a,  b 

Post 

14.68  (3.96) 

13.41  (3.87) 

Emotion-Focused  Factors 

Hazard-Related  Fears 

Pre 

1.62  (0.57) 

1 .66  (0.48) 

a,  c 

Post 

1 .55  (0.58) 

1 .54  (0.53) 

Perceptions  of  Co-students  Distress 

Pre 

2.19(0.49) 

2.17(0.45) 

a,  c 

Post 

2.23  (0.56) 

2.34  (0.48) 

Perceived  Emotional  Coping 

Pre 

4.24  (1.61) 

4.30(1.49) 

d 

Post 

4.21  (1 .72) 

4.21  (1.64) 

Note:  EC  =  Emergency  Condition;  FF  =  Familiar  Faces  Conditions;  subscripts  denote  the  following 
based  on  analysis  of  variance  (ANOVA),  a  =  trials  (time)  effect  significant;  b  =  interaction  effect  sig¬ 
nificant  (i.e.,  changes  across  time  by  group  differed);  c  =  interaction  effect  nonsignificant;  d  =  trials 
and  interaction  both  nonsignificant  (n  ranged  from  140  to  216  in  the  analyses). 

Table  1:  Problem-  and  Emotion-Focused  Factors:  Means  (and  Standard  Deviations)  and  ANOVA 
Summary 
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Table  2:  Zero-Order  Correlation  Matrix 
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sex;  X2= 

age;  Xa= 

=  social  status;  X4= 

Thessalonica;  X5- 

=  Athens;  X6= 

Kozani;  X7= 

Ethnic 

Other;  Xe= 

pre-fear  score;  X9= 

pre-others  upset;  X10=  pre-coping;  Xn=  post-fear  score;  X12=  post-others  upset;  X13=  post-coping;  X14=  pre-child  report  haz¬ 
ard  adjustments;  X15=  STAI  score  hazard  adjustments;  X16=  pre-knowledge;  X17=  post-child  hazard  adjustments;  X18=  post¬ 
survivor  hazard  adjustments;  X19=  post-knowledge;  X20=  child  adjustments  post-pre  change  score;  X21=  survivor  adjustments 
post-pre  change  score;  X22=  knowledge  post-pre  change  score;  X23=  fear  post-pre  change  score;  X24=  co-studentt  perception 
post-pre  change  score;  X25=  coping  post-pre  change  score;  X26=  intervention  group  (0  =  EC,  1  *  FF);  X27=  Room  EC  1 ;  X28= 
Room  EC  2;  Room  EC  3;  X30=  Room  EC  4;  X3i=  Room  FF  1;  X32=  Room  FF  2;  X33=  Room  FF  3;  X34=  Room  FF  4  ( n  ranged 
from  140  to  219);  *p<  0.05,  **p<  0.01  (two  tailed). 
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Abstract:  Alcohol  and  substance  abuse  is  the  number  one  mental  health  problem  in  America  as  well 
as  a  major  health  problem.  Although  brief  interventions  during  primary  care  visits  can  be  effective, 
clinicians  usually  do  not  act  on  signs  of  alcohol  abuse — often  because  they  do  not  know  how  to  inter¬ 
vene.  Clinicians  need  training  in  brief  intervention  techniques,  but  this  is  impractical  due  to  the  large 
number  of  clinicians,  the  high  costs,  and  the  daunting  logistics  of  the  only  effective  training  method 
currently  available — practice  with  standardized  patients.  To  address  this  need,  we  developed 
STAR™  Workshop,  an  online  training  workshop  incorporating  a  virtual  coach  and  virtual  standard¬ 
ized  patients.  The  STAR  coach  motivates  and  teaches  an  evidence-based  brief  intervention  protocol. 
STAR  virtual  patients  provide  practice  and  intrinsic  reinforcement.  After  each  practice  session,  the 
coach  offers  additional  feedback  and  any  needed  remediation.  We  comparatively  evaluated  STAR 
Workshop  against  a  self-paced  E-Book  covering  the  same  content  and  a  no-training  Control,  with 
medical  and  nursing  students  as  subjects.  Subjects  trained  with  STAR  Workshop  substantially  out¬ 
performed  subjects  in  the  other  conditions,  achieving  high  scores  on  self-assessments  of  their  own 
intervention  skills  and  intentions  to  intervene,  as  well  as  on  objective  assessments  of  their  interven¬ 
tion  skills,  based  on  both  short-answer  probes  and  recorded  interventions  with  live  standardized  pa¬ 
tients.  Thus,  STAR  Workshop  provides  a  scalable,  affordable,  and  effective  approach  to  training  brief 
intervention  skill  in  alcohol  abuse. 


INTRODUCTION: 

Alcohol  and  substance  abuse  is  the  number 
one  mental  health  problem  in  America  and  a 
major  health  problem,  impacting  individuals, 
families,  friends,  co-workers,  employers,  and 
communities.  Brief  interventions  administered 
during  routine  clinic  visits  have  been  shown  to 
be  effective  in  reducing  the  health  risks  and 
social  costs  of  alcohol  abuse1'4.  Primary  care 
settings  are  ideally  suited  for  intervention,  as 
patients  tend  to  visit  them  more  often  than 
medical  specialty  settings5.  Brief  interventions 
are  also  attractive  for  their  simplicity  and  low 
cost.  Following  a  simple  10-15  minute  interview 
protocol,  non-specialists  can  effectively  admin¬ 
ister  brief  interventions6. 

Unfortunately,  few  providers  routinely  screen 
patients  or  intervene  in  alcohol  abuse.  Flem¬ 
ing26  reports  20%  screening  rates  during  hospi¬ 
tal  admissions,  citing  insufficient  training  as  the 
primary  reason:  “Asking  patients  about  sensitive 
life-style  issues,  such  as  alcohol  use,  requires 


strong  communication  skills.  Many  physicians 
have  not  received  training  in  this  area.”  The 
Center  for  Addiction  and  Substance  Abuse 
(CASA)  finds  that  physicians  miss  signs  of  alco¬ 
hol  abuse  94%  of  the  time  and  1 1  %  of  patients 
report  physicians  who  were  aware  of  their  ad¬ 
dictions,  but  did  nothing7.  Calling  alcohol  and 
substance  abuse  America’s  #1  disease,  Joseph 
Califano,  President  of  CASA  and  former  Secre¬ 
tary  of  HEW,  said,  “Substance  abuse  is  an  ele¬ 
phant  in  the  examining  room.  Doctors  may  sim¬ 
ply  be  embarrassed  to  ask  the  key  questions. 
They  don't  want  to  anger  their  patients.  They 
think  patients  will  lie  about  this...  Medical 
schools  and  other  education  programs  for  phy¬ 
sicians  need  to  provide  more  training  on  how  to 
spot  and  deal  with  substance  abuse."  A  Com¬ 
monwealth  report  on  medical  education8  con¬ 
curs:  “Many  young  physicians  do  not  feel  confi¬ 
dent  counseling  patients  on  such  subjects  as 
smoking,  weight  reduction,  safe  sex  practices, 
domestic  violence  and  drug  and  alcohol  use.  To 
prepare  students  for  the  challenges  facing 
health  care  in  the  21st  century,  academic  health 
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centers  must  place  more  emphasis  on  skills 
traditionally  not  taught  in  medical  schools.  Phy¬ 
sicians  need  training  to  address  the  behaviors 
and  social  circumstances  at  the  root  of  many 
health  care  issues." 

For  inter-personal  skills  such  as  those  involved 
in  brief  intervention,  role-playing  has  long  been 
recognized  as  the  training  method  of  choice9. 
Roughly  80%  of  medical  training  centers  now 
integrate  role-play  with  "standardized  patients” 
as  part  of  a  problem-based  medical  curricu¬ 
lum6,10.  More  specifically  Fleming26  suggests 
that  “Role  playing  can  be  an  invaluable  way  to 
teach  physicians  how  to  become  more  comfort¬ 
able  with  alcohol  screening  questions  and  inter¬ 
viewing  techniques  allowing  them  to  rehearse 
their  skills  before  they  interact  with  their  pa¬ 
tients.  Because  nothing  can  substitute  for  prac¬ 
tice  and  repetitions,  role  playing  can  build  a 
physician’s  confidence  in  his  or  her  alcohol¬ 
screening  skills.” 

On  the  other  hand,  cost  and  logistics  make  this 
approach  impractical.  It  takes  10-30  times  as 
many  teaching  professionals  to  move  from  a  tra¬ 
ditional,  lecture-based  model  to  small  group  in¬ 
struction  of  5-10  students  in  problem-based  cur¬ 
ricula.  Many  smaller  community  teaching  hospi¬ 
tals  do  not  have  the  resources  to  implement 
problem-based  curricula  and  few  teachers  have 
expertise  in  conducting  small  groups8.  The  use 
of  standardized  patients  is  also  expensive.  The 
Uniformed  Services  University,  one  of  the  largest 
military  medical  training  centers  in  the  country, 
reports  annual  operating  costs  for  its  Medical 
Simulation  center  at  of  $1 .3  million  with  $300,000 
for  standardized  patients  and  $125,000  in  train¬ 
ing  costs11.  The  American  Medical  Association 
estimates  the  cost  of  clinical  skills  testing  with 
standardized  patients  as  high  as  $1,700  per 
test12.  Similarly,  test  preparation  companies  are 
charging  approximately  $1 ,000  per  day  for  small 
group  workshops  with  standardized  patients. 

Moreover,  even  live  workshops  and  role-plays 
appear  to  have  limited  efficacy.  In  our  own  stud¬ 
ies  of  inter-personal  skills  for  management-staff 
communication  (which  are  in  many  ways  analo¬ 
gous  to  brief  intervention  skills),  live  training 
workshops  featuring  professional  instructors 
and  peer  role-players  produced  high  learner 
satisfaction  and  self-reports  of  skills  improve¬ 
ment,  but  little  or  no  improvement  on  objective 


performance  measures13.  Similarly,  in  several 
studies  of  motivational  interviewing  for  alcohol 
abuse,  live  training  workshops  produced  self- 
reports  of  skills  improvement  up  to  4  months 
later,  but  only  modest  improvements  (too  small 
to  affect  client  response)  in  objective  observa¬ 
tions  of  interviewing  performance14'16. 

We  believe  that  these  disappointing  results  re¬ 
flect  common  misconceptions  about  the  nature 
of  sophisticated  inter-personal  skills  and  the 
training  experiences  required  for  individuals  to 
master  such  skills  and  incorporate  them  into 
everyday  practice.  First,  many  people  underes¬ 
timate  the  high  skill  levels  required  for  efficacy 
in  sensitive  inter-personal  interactions  and  the 
amounts  of  practice  and  coaching  required  to 
attain  skill  levels.  Compounding  this  misconcep¬ 
tion,  many  people  suffer  “cognitive  illusions”  in 
which  they  overestimate  the  efficacy  of  unchal¬ 
lenging  training  experiences  and  the  skills  they 
engender17.  Third,  instructors  and  standardized 
patients  vary  in  their  own  expertise  and  consis¬ 
tency.  After  all,  they  are  only  human!  In  sum, 
we  believe  that  even  expert  researchers  and 
training  providers  err  in  attempting  to  achieve 
ambitious  training  objectives — mastery  of  so¬ 
phisticated  inter-personal  skills — by  providing 
an  insufficient  amount  of  insufficiently  challeng¬ 
ing,  variable-quality  training  experience. 

To  address  the  need  for  effective,  efficient,  af¬ 
fordable,  scalable  training  in  brief  intervention 
skills,  we  developed  STAR™  Workshop  for 
Brief  Intervention  in  Alcohol  Abuse18.  Following 
the  literature  on  enhancing  human  perfor¬ 
mance17,  19,  STAR  Workshop  implements  a 
Guided  Mastery™  pedagogical  strategy,  featur¬ 
ing  a  virtual  coach  and  several  virtual  standard¬ 
ized  patients  (VSPs),  all  built  on  interactive 
character  technology80'22.  Figure  1  displays  ex¬ 
cerpts  from  a  training  session  in  STAR  Work¬ 
shop. 

Like  live  workshops  with  standardized  patients, 
STAR  Workshop  provides  expert  instruction,  au¬ 
thentic  practice,  and  detailed  feedback.  In  con¬ 
trast  to  live  workshops,  STAR’S  Guided  Mastery 
strategy  provides  as  much  practice  and  as  much 
coaching  as  each  individual  learner  requires, 
systematic  guidance  to  mastery  of  target  skills, 
and  individually  optimized  learning  paths.  Thus, 
in  addition  to  being  affordable  and  scalable,  we 
hypothesize  that  STAR  Workshop  will  be 
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uniquely  effective  and  efficient  in  its  training  of 
brief  intervention  skills.  The  present  study  is  de¬ 
signed  to  evaluate  that  hypothesis. 

MATERIALS  AND  METHODS: 

Target  Protocol.  To  provide  a  training  target  for 
our  study,  we  developed  a  brief  intervention 
protocol  called  Engage  for  Change™  (E4C™). 
The  E4C  protocol  adapts  the  evidence-based 
techniques  of  motivational  interviewing15.  Given 
the  practical  needs  of  a  large  and  diverse  popu¬ 
lation  of  primary-care  clinicians,  and  the  opera¬ 
tional  requirements  of  automating  the  training 
process,  the  E4C  protocol  also  was  constrained 
to  be  general,  brief,  memorable,  teachable,  and 
verifiable.  At  the  most  general  level,  the  E4C 
protocol  is  as  follows: 

A.  Inform  the  patient  of  health  risks: 

1 .  Raise  the  topic  of  alcohol  consumption  in  a 
general  health  context. 

2.  Inform  the  patient  of  his  or  her  specific 
health  risks  associated  with  alcohol. 

B.  Acknowledge  the  patient’s  point  of  view: 

3.  Invite  the  patient  to  express  his  or  her 
concerns  about  health  consequences  of 
alcohol 

4.  Accept  the  patient’s  stated  concerns. 

C.  Encourage  the  patient  to  make  a  change. 

5.  Invite  the  patient  to  make  an  appropriate 
change  step. 

6.  Ask  the  patient  to  commit  to  make  the 
change  step. 

Motivational  interviewing  was  developed  origi¬ 
nally  as  a  compassionate  alternative  to  confron¬ 
tational  methods  for  treating  addiction.  Its  effi¬ 
cacy  is  supported  by  many  studies,  including 
studies  of  intervention  in  alcohol  abuse  in  par¬ 
ticular  2'14'23-24.  Thus,  the  E4C  protocol  should 
be  similarly  effective  for  brief  intervention  in  the 
abuse  of  alcohol.  However,  verification  of  its 
clinical  efficacy  is  beyond  the  scope  of  this 
study. 


Instructional  Content.  We  created  41  Web 
pages  containing  23  pages  of  instructional  con¬ 
tent  for  use  with  all  learners;  12  pages  of  coach¬ 
ing  content  to  be  used  with  individual  learners  at 
the  coach's  discretion;  and  6  pages  for  display¬ 
ing  VSP  medical  histories  and  role-play  scores. 

Virtual  Coach.  We  created  a  virtual  coach 
named  “Harmony.”  She  has  an  animated  em¬ 
bodiment  with  -25  gestures  and  facial  expres¬ 
sions,  which  she  uses  to  complement  her  dia¬ 
logue.  She  delivers  her  dialogue  in  a  synthe¬ 
sized  voice  and  typed  speech  bubbles,  person¬ 
alizing  it  to  call  the  student  by  name,  quote  seg¬ 
ments  of  the  student’s  role  play  conversations 
with  VSPs,  etc.  Harmony  presents  80  instruc¬ 
tional  topics,  with  -100  associated  lines  of  in¬ 
structional  dialog.  She  also  has  -300  lines  of 
feedback  dialogue  which  she  selects  and  in¬ 
stantiates  with  student-specific  information.  She 
has  -100  lines  of  coaching  dialogue,  which  she 
selects  based  on  student  performance.  She  has 
124  preconditions,  which  she  uses  to  select  dia¬ 
logue  and  actions.  Harmony  currently  accepts 
only  point-and-click  input  from  students  wishing 
to  continue  or  quit. 

Virtual  Standardized  Patients.  We  created  3 
VSPs — Lee,  Nina,  and  Ed — differing  in  gender, 
age,  culture,  personality,  health  scenario,  resis¬ 
tance,  and  referral  needs.  Each  VSP  has  a  pho¬ 
tographic  embodiment  (created  with  actors), 
with  -25  gestures  and  facial  expressions,  which 
he  or  she  uses  to  complement  dialogue.  VSPs 
deliver  their  dialogue  in  recorded  human  voice 
(created  by  actors)  and  typed  speech  bubbles. 
They  accept  typed  natural  language  input  from 
students.  Each  VSP  has  1 2  conversational  con¬ 
texts,  with  -200  lines  of  dialogue  and  2-6  alter¬ 
nate  wordings  for  each  line.  They  recognize  80 
sets  of  semantically  equivalent  student  inputs, 
with  8-20,000  alternate  wordings  accepted  for 
each  one.  VSPs  have  75  preconditions,  which 
they  use  to  select  dialogue,  gestures,  or  a  new 
conversation  context.  They  have  18  moods 
(e.g.,  confident,  unconfident,  edgy,  defensive, 
comfortable),  which  are  influenced  by  their  inter¬ 
action  with  a  student  and  manifest  in  the  selec¬ 
tion  of  dialogue,  gesture,  and  context. 

Training  Conditions.  Our  study  had  3  training 
conditions:  STAR  Workshop,  E-Book,  and  Con¬ 
trol.  STAR  Workshop  is  described  above  and 
incorporates  all  instructional  content,  the  virtual 
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coach,  and  the  4  VSPs.  For  E-Book,  we  created 
a  self-paced  course,  with  Web  pages  incorporat¬ 
ing  all  instructional  content  created  for  STAR 
Workshop,  plus  all  of  the  STAR  Coach’s  instruc¬ 
tional  dialogue.  Students  could  access  the  E- 
Book  like  a  conventional  e-learning  application, 
choosing  whether  or  not  to  follow  the  recom¬ 
mended  page  sequence,  how  much  time  to 
spend  on  each  page,  etc.  The  Control  condition 
had  no  training. 

Subjects.  31  subjects  included  medical  students 
from  Stanford  University  and  nursing  students 
from  the  University  of  San  Francisco  and  San 
Jose  State  University.  We  assigned  subjects  to 
training  conditions  semi-randomly,  balancing 
education,  age,  gender,  ethnicity,  and  pre¬ 
training  assessments  of  attitudes  and  skills 
(discussed  below).  We  did  not  predict  or  find  any 
effects  of  these  variables  and  do  not  refer  to 
them  further.  Subjects  were  paid  $100  for  their 
participation. 

Procedure.  The  following  procedure  was  ap¬ 
plied  for  all  subjects: 

•  Pre-Training  Assessment  -  Self-reports  of 
attitudes  and  short-answer  skills  probes; 

0  Training  -  STAR  Workshop  or  E- 
Book  or  Control 

•  Post-Training  Assessment  -  Self-reports 
of  attitudes  and  short-answer  skills 
probes; 

0  2  Week  Post-Training  Retention  Inter¬ 
val 

•  Post-Delay  Intervention  with  a  Live  Stan¬ 
dardized  Patient  (LSP)  -  Telephone  inter¬ 
view 

•  Post-Delay  Assessment  -  Self-reports  of 
attitudes  and  short-answer  skills  probes. 


Attitude  Assessments.  Subjects  used  5-point 
Likert  scales  to  report  their  attitudes  toward 
these  statements:  1.  The  E4C  protocol  is  effec¬ 
tive.  2.  The  E4C  protocol  is  practical.  3.  My 
training  method  was  effective.  4.  I  am  confident 
in  my  brief  intervention  skills.  5.  I  plan  to  inter¬ 


vene  with  patients  who  show  signs  of  alcohol 
abuse.  For  STAR  and  E-Book  subjects,  pre¬ 
training  assessments  included  statements  4  and 
5;  post-training  and  post-delay  assessments 
contained  statements  1-4.  For  Control  subjects, 
all  assessments  included  only  statements  4  and 
5. 

Efficacy-Skills  Probes.  Subjects’  skills  were 
assessed  with  short-answer  probes,  represent¬ 
ing  the  6  steps  in  the  E4C  protocol,  on  all  3  as¬ 
sessments.  Responses  were  scored  0-3  points: 
correct  step,  correct  step  in  context,  no  errors 
(e.g.,  patronize,  contradict,  advocate  change). 

Sample  Basic  Probe  Item:  Troy,  43,  an  at¬ 
torney,  is  at  your  clinic  to  check  his  recov¬ 
ery  from  a  broken  collarbone  suffered  in  a 
car  crash.  On  his  medical  history,  he  re¬ 
ports  that  he  consumes  30  drinks  of  alcohol 
per  week.  He  also  reports  frequent  insom¬ 
nia  and  gastritis,  which  you  think  may  be 
related  to  his  alcohol  consumption.  Troy 
says:  “The  shoulder’s  much  better.  We’re 
done  for  today,  right?"  What  do  you  say? 
Correct  response  step:  Step  1 .  Raise  the 
topic  of  alcohol  consumption  in  a  health 
context. 

Sample  correct  responses: 

“I  would  like  to  spend  a  few  minutes  ex¬ 
plaining  how  drinking  may  be  affecting  your 
health.” 

“Troy,  I  want  to  discuss  the  role  of  alcohol 
as  a  contributing  factor  to  insomnia.” 

“Let’s  talk  about  the  how  alcohol  consump¬ 
tion  may  be  contributing  to  your  gastritis.” 

Note:  Besides  basic  probes,  our  study  included 
easier  cued  probes  and  more  difficult  open 
probes.  Since  all  probes  showed  comparable 
effects,  we  discuss  only  basic  probes  here. 

Transfer  of  Retained  Skills — Live  Intervention. 
Subjects’  skills  were  assessed  in  performance 
of  telephone  interventions  with  a  live  standard¬ 
ized  patient  (LSP),  conducted  after  the  2-week 
post-training  retention  interval.  Subjects  re¬ 
ceived  the  case  history  below  and  then  were 
given  10  minutes  to  conduct  the  intervention. 
The  recorded  intervention  was  scored  0-18 
points,  with  0-3  points  (correct  step,  correct  step 
in  context,  no  errors)  for  each  step  in  the  E4C 
protocol. 
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The  LSP  Case  History.  Morgan,  51,  a  re¬ 
cently  divorced  attorney  and  mother  of  2,  is 
at  the  clinic  for  an  allergy  shot.  Her  previ¬ 
ous  record  indicates  low-normal  blood 
pressure  and  overall  good  health.  On 
exam,  her  blood  pressure  is  significantly 
higher  than  on  previous  exams.  She  has  a 
slight  cough  today  and  reports  that  she  is 
recovering  from  a  cold.  On  her  medical  his¬ 
tory,  she  reports  drinking  2-3  glasses  of 
wine  daily.  She  has  occasional  headaches 
and  moderate  stress.  According  to  NIAAA 
guidelines,  a  woman  may  be  at  risk  for  al¬ 
cohol-related  problems  if  she  consumes 
more  than  7  alcoholic  drinks  a  week  or 
more  than  3  drinks  a  day.  High  blood  pres¬ 
sure  and  headaches  are  both  associated 
with  heavy  drinking.  You  are  concerned 
that  Morgan’s  alcohol  use  may  be  contrib¬ 
uting  to  these  conditions  and  that  she  may 
be  headed  for  future  health  problems.  You 
suspect  that  her  drinking  may  be  having 
negative  impacts  on  other  areas  of  her  life, 
as  well.  An  appropriate  referral  for  Morgan 
might  be  to  a  behavioral  health  case  man¬ 
ager  to  develop  a  reduction  plan. 

Scoring  and  Data  Analysis.  Two  judges  blindly 
and  independently  scored  responses  for  skills 
probes  and  live  interventions.  An  independent  3rd 
person  combined  judges’  scores  and  entered 
them  in  spreadsheets  along  with  self-report  atti- 
tudinal  data,  key  demographic  data,  and  learning 
path  data  automatically  recorded  by  STAR  and 
e-Book.  Summary  statistics  were  computed  in 
these  spreadsheets.  We  omit  conventional  statis¬ 
tics;  these  would  be  redundant  and  obvious, 
given  the  large  and  consistent  differences  ob¬ 
served. 

RESULTS: 

Verifiable  Individual  Progress  and  Individually 
Optimized  Training  with  STAR  Workshop 

100%  of  subjects  in  the  STAR  Workshop  condi¬ 
tion  mastered  the  E4C  protocol.  Subjects  dis¬ 
played  individual  progress  in  performance  im¬ 
provements  with  successive  VSPs:  increasing 
initial  role-play  scores  (means  =  4, 1 4, 1 7  out  of  a 
perfect  score  of  18),  decreasing  number  of  role- 
plays  required  for  mastery  (means  =  6,  3,  2),  de¬ 
creasing  number  of  step-coaching  events  re¬ 
quired  for  mastery  (means  =  14.3,  5.7,  2.8).  In 


addition,  100%  of  STAR  subjects  were  guided 
along  unique  learning  paths,  optimizing  the  se¬ 
quence,  duration,  and  content  of  instruction,  role- 
play,  feedback  and  coaching,  based  on  individual 
progress  and  specific  individual  behaviors  during 
role-play.  As  a  consequence,  subjects  varied 
widely  in  the  number  of  minutes  they  spent  on: 
instruction  (range  =  15-23),  role-play  (range  = 
24-105),  and  coaching  (range  =  28-131). 

Comparison  of  Immediate  Impact  and  Efficacy 
of  STAR,  E-Book,  and  Control 

STAR  and  E-Book  produced  comparable  positive 
immediate  impact  on  subjects’  attitudes.  Subjects 
judged  the  E4C  protocol  effective  (mean  =  5  vs. 
5)  and  practical  (mean  =  4  vs.  4),  They  gave 
positive  ratings  to  their  training  (mean  =  4  vs.  4), 
their  intervention  skills  (mean  =  4.5  vs.  4.25),  and 
their  intentions  to  intervene  with  patients  showing 
signs  of  abuse  (mean  =  5  vs.  4). 

However,  E-Book  subjects  performed  only 
slightly  better  than  Control  (no  training)  subjects 
on  skill  probes  of  immediate  efficacy.  72%  vs. 
62%  of  subjects  improved  over  pre-training 
skills,  achieving  22%  vs.  10%  of  the  maximum 
possible  improvement.  Subjects  averaged  61% 
vs.  50%  correct  responses  on  post-training  as¬ 
sessment,  with  no  subjects  in  either  group  scor¬ 
ing  >90%.  Thus,  E-Book  subjects’  positive  self- 
assessments  reflected  over-confidence. 

By  contrast,  STAR  subjects  performed  substan¬ 
tially  better  than  E-Book  and  Control  subjects, 
and  at  a  high  absolute  level,  on  skills  probes  of 
immediate  efficacy.  100%  of  STAR  subjects 
improved  over  pre-training  skills,  achieving  78% 
of  the  maximum  possible  improvement.  STAR 
subjects  averaged  89%  correct  responses  on 
post-training  assessment,  with  46%  scoring 
>90%.  Thus  STAR  subjects’  performance  vali¬ 
dated  their  positive  self-assessments. 

Comparison  of  Retained  Impact  and  Efficacy  of 
STAR,  E-Book,  and  Control 

Results  for  retained  impact  and  efficacy,  follow¬ 
ing  the  2-week  retention  interval,  were  similar  to 
but  more  exaggerated  than  results  for  immedi¬ 
ate  impact  and  efficacy. 

Again,  STAR  and  E-Book  produced  comparable 
positive  retained  impact  on  subjects’  attitudes, 
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identical  to  the  immediate  data,  except  E-Book 
subjects  reduced  their  mean  assessment  of  the 
effectiveness  of  the  E4C  protocol  from  5  to  4. 

On  skill  probes  of  retained  efficacy,  E-Book  sub¬ 
jects  fell  even  closer  to  Control  subjects,  whose 
scores  remained  constant.  64%  vs.  62%  of  sub¬ 
jects  improved  over  pre-training  skills,  achieving 
1 1  %  vs.  1 0%  of  the  maximum  possible  improve¬ 
ment.  Subjects  averaged  56%  vs.  50%  correct 
responses  on  delayed  skills  probes,  with  no 
subjects  in  either  group  scoring  >90%.  Thus, 
after  a  2-week  retention  interval,  training  with  E- 
Book  was  no  better  than  no  training  at  all. 

Again  by  contrast,  STAR  subjects  performed 
substantially  better  than  E-Book  and  Control  sub¬ 
jects,  and  at  a  high  absolute  level,  on  skills 
probes  of  retained  efficacy.  100%  of  STAR  sub¬ 
jects  improved  over  pre-training  skills,  achieving 
78%  of  the  maximum  possible  improvement. 
STAR  subjects  averaged  89%  correct  responses 
on  delayed  skills  probes,  with  55%  scoring 
>90%.  Thus  STAR  subjects  retained  their  excel¬ 
lent  skills  over  the  2-week  retention  interval. 

Comparison  of  Transfer  of  Retained  Skills  to 
Live  Intervention 

On  transfer  to  live  intervention,  E-Book  scores 
were  similar  to  Control  scores.  Subjects  in  both 
groups  averaged  50%  correct,  with  no  subjects 
in  either  group  scoring  >90%.  However,  only 
18%  of  E-Book  subjects  made  no  extraneous 
errors,  compared  to  38%  of  Control  subjects. 
Again,  training  with  E-Book  is  no  better  than  no 
training  at  all. 

STAR  subjects  performed  substantially  better 
than  E-Book  and  Control  subjects,  and  at  a  high 
absolute  level,  on  transfer  to  live  intervention. 
STAR  subjects  averaged  94%  correct  perform¬ 
ance,  with  55%  scoring  >90%,  and  82%  making 
no  extraneous  errors.  In  fact,  these  scores  are 
at  least  as  good  as  the  scores  on  the  immediate 
and  delayed  skills  probes.  Thus  STAR  Work¬ 
shop  prepared  subjects  to  perform  quite  well  in 
live  interventions  2  weeks  after  training. 

DISCUSSION: 

Results  of  the  present  study  demonstrate  the 
efficacy  of  STAR  Workshop  for  training  clini¬ 
cians  in  the  E4C  protocol  for  brief  intervention  in 


alcohol  abuse.  STAR  subjects  performed  ex¬ 
tremely  well  on  both  immediate  and  delayed 
skills  probes  and  on  the  critical  test  of  interven¬ 
tion  with  a  live  standardized  patient.  In  addition, 
STAR  subjects  showed  100%  uniqueness  and 
broad  variability  of  learning  paths,  tied  to  indi¬ 
vidual  progress  on  learning  objectives.  Thus, 
the  results  confirm  our  hypothesis  that  STAR 
Workshop  would  provide  effective  and  efficient 
training  in  brief  intervention  skills. 

Results  of  the  study  also  indicate  that  training 
with  E-Book  self-paced  learning  may  induce 
cognitive  illusions  in  which  learners  over¬ 
estimate  the  efficacy  of  their  training  and  their 
own  competence.  Although  E-Book  subjects 
reported  high  confidence,  comparable  to  STAR 
subjects,  their  performance  was  poor  and  com¬ 
parable  to  no-training  Control  subjects  on  all 
immediate  and  delayed  skills  probes,  as  well  as 
on  intervention  with  a  live  standardized  patient. 

Although  this  study  did  not  include  a  live  training 
condition,  it  is  noteworthy  that  STAR  subjects 
demonstrated  very  strong  intervention  skills  on 
all  assessments  and  especially  on  their  inter¬ 
ventions  with  a  live  standardized  patient.  With 
enhancements  to  STAR  Workshop — for  exam¬ 
ple,  practice  with  a  greater  variety  of  VSPs — 
performance  will  approach  a  ceiling,  leaving  the 
possibility  for  only  small  improvements,  at  best, 
for  live  training.  Given  the  high  cost  and  daunt¬ 
ing  logistics  of  live  training,  STAR  Workshop 
may  offer  an  extremely  attractive  alternative, 
matching  the  efficacy  of  live  training  at  a  lower 
cost.  While  further  study  is  required  to  clarify 
these  cost-benefit  trade-offs,  the  prospect  of  a 
Pareto  optimal  approach  is  tantalizing. 

It  also  is  worth  noting  that  the  E4C  protocol  is  a 
variable  in  our  study  and  in  STAR  Workshop. 
Although  prior  research  on  motivational  inter¬ 
viewing  suggests  that  E4C  should  be  clinically 
effective  for  brief  intervention  in  alcohol  abuse, 
it  is  quite  possible  that  new  research  might  sug¬ 
gest  improvements  to  the  protocol  or  an  alterna¬ 
tive  more  effective  protocol.  STAR  Workshop 
can  be  applied  to  teach  any  such  new  or  modi¬ 
fied  protocol.  In  fact,  STAR  Workshop  can  be 
an  important  tool  supporting  large-scale  clinical 
trials  of  alternative  intervention  protocols,  by 
providing  an  efficient  and  effective  means  of 
verifiably  training  large  numbers  of  clinicians  to 
reliably  follow  experimental  protocols. 
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In  sum,  the  present  findings  provide  a  promising 
foundation  for  developing  a  comprehensive  pro¬ 
gram  for  training  brief  intervention  in  alcohol 
abuse  and  delivering  it  to  a  broad  range  of  pri¬ 
mary-care  clinicians  in  a  form  that  is  practical, 
scalable,  and  affordable.  This  would  enable  a 
larger  number  of  clinicians  to  perform  more  ef¬ 
fective  interventions  with  a  larger  number  and 
diversity  of  patients,  at  earlier,  more  treatable 
disease  stages.  This,  in  turn,  would  enhance 
immediate  and  life-long  patient  health,  while 
reducing  immediate  and  life-long  costs  of  health 
care. 

Success  with  this  important  application  would 
also  lay  the  groundwork  for  developing  STAR 
Workshops  to  train  effective  intervention  proto¬ 
cols  for  drug  abuse,  obesity,  eating  disorders, 
exercise,  safe-sex,  diabetes  management, 
asthma  management,  and  other  conditions 
where  health  outcomes  and  costs  depend  on 
clinician  skills  for  facilitating  change  in  patient 
behavior. 
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Figure  1:  Illustrative  Excerpts  from  a  Training  Session  in  STAR  Workshop. 


Kay  (pseudonym),  a  Stanford 
medical  student,  is  learning  the 
E4C  protocol  in  STAR  Work¬ 
bench. 

Harmony,  the  STAR  Coach, 
explains,  motivates,  and  illus¬ 
trates  each  step  in  the  proto¬ 
col. 


Lee,  a  VSP,  gives  Kay  au¬ 
thentic  practice,  conversing 
with  her  in  natural  language, 
complemented  by  appropriate 
facial  expressions,  body  lan¬ 
guage,  and  emotional  dynam¬ 
ics.  Lee’s  life-like  behavior 
provides  intrinsic  reinforce¬ 
ment  of  Kay’s  performance. 

Even  smart  students  like  Kay 
make  errors  on  early  practice. 


Kay,  when  inviting  your  patient  to  express  I 
concerns,  try  to  cultivate  an  atmosphere  of  trust 
and  the  patient’s  sense  of  autonomy. 

Be  sure  to  ask  an  open-ended  question  that 
invites  more  than  a  yes  or  no  answer.  A  patient 
who  can  speak  freely  may  reveal  a  lot  about 
motivation  and  readiness  to  change. 


Step  3.  Invite  the  patient  to  express  concerns... 

by  asking  open-ended  questions  that  relate  drinking 
behavior  to  health,  work,  social,  or  family  consequences 

Example: 

“How  do  you  think  your  use  of  alcohol  may  be  affecting 
your  health?” 


Kay,  a  Stanford  medical  student  (pseudonym), 
performs  her  1st  post-training  role  play  practice 
with  Lee,  a  virtual  standardized  patient  (VSP) 

Lee:  I  really  thought  I  had  broken  a  bone. 

Kay:  Lee,  I  would  like  to  talk  about  how 
alcohol  is  affecting  your  health. 

Lee:  OK,  fine. 

Kay:  You  need  to  reduce  your  drinking,  Lee. 

Lee:  I  don't  know  that  I  want  to  do  that. 

Kay:  Well,  you  should  think  about  it. 

Lee:  I  didn't  come  here  for  a  lecture.  So,  good-bye 


Harmony  scores  Kay’s  role- 
play  performance.  She  offers 
detailed,  personalized  feed¬ 
back,  calling  Kay  by  name 
and  quoting  segments  of  her 
dialogue  with  Lee. 

Harmony  provides  explicit, 
systematic  reinforcement  of 
strengths  and  weaknesses  in 
Kay’s  intervention  with  Lee. 
For  each  step  in  the  E4C  pro¬ 
tocol,  Harmony  explains  what 
Lee  did,  whether  or  not  it  was 
correct,  and  what  its  conse¬ 
quences  were. 


Kay,  that  didn’t  go  very  well,  did  it?  Don’t  worry. 
You  can  try  again  in  a  moment.  Let’s  review. 

You  did  a  good  job  raising  the  topic  of  Lee’s 
drinking  when  you  said,  "Lee,  I  would  like  to  talk 
about  how  alcohol  is  affecting  your  health. ”  By 
raising  the  topic  in  a  neutral  health  context,  you 
made  Lee  feel  comfortable  and  willing  to  discuss 
his  drinking.  Good  work,  Kay. 

Next,  you  should  have  informed  Lee  of  his 
specific  health  risks  associated  with  drinking. 
Instead,  you  suggested  that  Lee  change  his 
behavior,  when  you  said,  “You  need  to  reduce 
your  drinking,  Lee." 

I  know  this  was  good  medical  advice,  Kay. 
However,  advocating  change  prematurely  actually 
made  Lee  more  resistant.  ...  [etc.] 
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Harmony  gives  Kay  remedial  instruc¬ 
tion  only  for  those  protocol  steps  on 
which  she  made  errors  in  her  most 
recent  role-play  practice. 

Harmony  suggests,  motivates,  and 
illustrates  substitute  behaviors  for 
Kay  to  try  in  her  next  role-play  prac¬ 
tice. 


Kay,  informing  your  patient  of  risks  associated 
with  alcohol  consumption  is  one  of  your  i 
important  functions. 

Remember  to  tell  your  patient  how  drinki 
impacts  his  or  her  specific  health  conditic 

Your  message  will  most  likely  be  heard  il 
stick  to  the  facts  and  refrain  from  criticizii 
your  patient’s  current  drinking  behavior  c 
advising  a  particular  course  of  action. 


Inform  the  patient  of  specific  risks... 

by  simply  stating  the  relevant  facts. 

Example  1 :  “You  have  elevated  blood  pressure  and  gastritis. 
Alcohol  can  be  a  contributing  factor  to  both  of  these  conditions.” 

Example  2:  “Drinking  alcohol  is  associated  with  headaches  and 
difficulty  sleeping.  I  noticed  that  you  have  both  of  these  problems.’ 


Kay  masters  the  E4C  protocol  on  her 
5th  role-play  with  Lee. 

Note  that  VSP  Lee  provides  authen¬ 
tic  repeat  practice.  He  responds  ap¬ 
propriately  to  changes  in  Kay’s  be¬ 
havior  and  introduces  normal  vari¬ 
ability  in  his  own  dialogue.  Thus,  Kay 
cannot  simply  remember  a  correct 
“script”  for  intervening  with  Lee.  She 
must  listen  and  engage  expertly  with 
Lee  on  every  practice. 


Kay's  5th  role  play  with  VSP  Lee  is  perfect 

Lee:  Well,  I'm  relieved  there’s  no  fracture. 

Kay:  Let’s  discuss  the  impact  of  alcohol  on  your  he; 

Lee:  OK,  fine. 

Kay:  Your  alcohol  consumption  may  be  negatively 
affecting  your  ulcers,  blood  pressure,  and  sleep. 

Lee:  Well,  that’s  certainly  one  of  the  downsides. 

Kay:  Lee,  what  effect  do  you  think  alcohol  has  on  your  health? 
Lee:  I  hate  having  the  ulcer!  Drunks  have  ulcers.  Believe  me,  I’m 
not  getting  any  more  drunk  diseases! 

Kay:  You’re  worried  that  drinking  is  causing  your  ulcers. 

Lee:  To  be  honest,  it’s  tougher  to  quit  than  !  thought  it  would  be. 
Kay:  I  know  a  counselor  that  you  might  be  interested  in  seeing. 
She's  helped  other  young  professionals  like  you  change  their 
drinking  patterns. 

Lee:  Interesting. 

Kay:  Will  you  follow  through  with  this  referral? 

Lee:  All  right.  I'm  going  to  do  it.  OK,  Bye  now.  And  thanks. 


Coach  Harmony  congratulates  Kay 
on  her  mastery  of  the  E4C  protocol 
with  Lee.  She  systematically  rein¬ 
forces  every  element  of  Kay’s  correct 
performance. 

Next,  Harmony  will  introduce  VSP 
Nina  and,  later,  VSP  Ed.  With  each 
of  them,  she  will  guide  Kay  through 
the  same  individualized  process  of 
practice-feedback-coaching ,  leadi ng 
her  to  mastery  of  the  E4C  protocol. 


Excellent  Kay!  You’ve  mastered  the  role  j 
play  with  Lee.  Let’s  review. 

Another  good  start  for  you,  Kay.  You  said,  A 
" Let’s  discuss  the  impact  of  alcohol  on  yoi  JT 
health.  ”  By  introducing  the  topic  in  a  hea  IP 
context,  you  made  Lee  feel  comfortable  ai 
willing  to  discuss  his  alcohol  consumption 

Kay,  this  is  your  best  score  so  far  on  step 
You  informed  Lee  of  his  specific  health 
risks  when  you  said,  "Your  alcohol  -  - 

consumption  may  be  negatively  affecting  - 

your  ulcers,  blood  pressure,  and  sleep.  ”  tagemen 

Again,  Kay,  you  did  a  good  job  inviting  . . . 

[etC‘] _ _ _  risks. 

Acknowledge  the  Patient's  Point  of  View 

3.  Invite  the  patient  to  express  concerns. 

4.  Accept  the  patient's  stated  concerns. 

Encourage  the  Patient  to  Make  a  Change 

5.  Invite  the  patient  to  move  towards  change. 

6.  Encourage  the  patient  to  commit  to  the  change. 
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Abstract:  As  computer  and  Internet  use  become  a  staple  of  everyday  life,  the  potential  for  overuse  is 
introduced,  which  may  lead  to  addiction.  Applications  such  as  online  chat  on  Internet  Relay  Chat 
(IRC)  and  text  based  role-playing  games  on  Multi-User  Domains  (MUDS)  have  been  extremely  popu¬ 
lar  for  years.  Research  on  internet  addiction  has  shown  these  are  the  types  of  applications  users  be¬ 
come  addicted  to.  Recently,  these  applications  have  evolved  into  graphically  intense  three  dimen¬ 
sional  virtual  worlds  called  Massively  Multiplayer  Online  Role-Playing  Games  ( MMORPGs ).  Addiction 
to  the  Internet  shares  some  of  the  negative  aspects  of  substance  addiction  and  has  been  shown  to 
lead  to  consequences  such  as  failing  school  as  well  as  familial  and  relationship  problems.  The  fac¬ 
tors  surrounding  these  cases  must  be  examined  from  an  HCI  perspective  as  they  pertain  to  both 
computer  usage  and  the  impact  it  has  on  its  users. 


BACKGROUND 

Internet  addiction  is  not  yet  a  DSM  IV  diagnosis, 
but  its  definition  has  been  derived  from  DSM  IV 
criteria  for  addiction  and  obsession.  Young  [1 8] 
coined  the  term  “Internet  Addiction  Disorder” 
listing  diagnostic  criteria,  which  many  research¬ 
ers  refer  to  as  a  starting  point.  Yet,  there  is  no 
official  DSM  IV  diagnosis,  and  because  of  this, 
researchers  of  Internet  addiction  form  their  own 
criteria  for  this  disorder.  Of  those  criteria,  the 
two  most  referred  to  are  substance  abuse 
(addiction  to  chemicals)  or  behavioral  obses¬ 
sions  and/or  compulsions.  There  is  an  ongoing 
debate  among  psychologists  on  what  distin¬ 
guishes  certain  addictions  from  obsessive  be¬ 
haviors.  A  substance  addiction  is  defined  as 
something  which  you  enjoy  doing,  or  initially 
enjoyed,  and  eventually  involves  physical  de¬ 
pendence.  Researchers  such  as  Young  [18] 
replace  the  word  “substance”  with  “Internet”  in 
their  analysis  of  Internet  addiction,  concluding 
that  similar  symptoms  such  as  tolerance 
(needing  more  substance  or  Internet  for  satis¬ 
faction),  withdrawal  (a  need  for  the  substance  or 
Internet  when  one  does  not  have  it  available), 
craving  (doing  more  of  the  substance  or  Internet 
and  investing  more  time  into  it),  and  negative 
life  consequences  Gob  loss,  family  and  social 
problems)  are  present  in  Internet  addiction  as 
well.  An  obsession  can  be  described  as  ideas 
or  thoughts  that  dominate  a  person's  mind. 
Compulsions  can  be  irresistible  urges  or  repeti¬ 


tive  behaviors  (cleaning  or  checking  something 
continually).  It  is  a  behavior  often  done  in  re¬ 
sponse  to  an  obsession.  Research  done  by 
Walker  [14]  would  label  Internet  addiction  an 
obsessive  and  compulsive  behavior,  based  on 
its  similarities  to  gambling  addiction  and  com¬ 
pulsive  shopping,  since  all  of  these  disorders 
lack  chemical  dependence.  Still,  very  little  is 
known  about  Internet  addiction  as  a  whole. 

Early  research  done  by  Shotton  [12],  who  re¬ 
searched  Internet  addiction  in  the  early  90’s, 
concluded  that  addicted  computer  users  were 
mainly  male  introverts.  These  men  were  highly 
educated,  had  an  affinity  for  computers,  and 
had  a  constant  need  for  intellectual  stimulation. 
However,  that  data  is  no  longer  relevant.  A  few 
years  later,  studies  by  Griffiths  [4,  5],  O’Reilly  [9] 
and  Young  [1 5-1 8]  reached  drastically  different 
conclusions.  Their  results  revealed  that  depend¬ 
ent  users  were  primarily  middle-aged  females 
on  home  computers  [1 6]  and  anyone  with  inter¬ 
net  access  could  become  addicted  [9].  This 
drastic  shift  has  come  about  simply  because 
there  are  more  Internet-ready  computers  in 
homes  now  than  in  1991.  This  is  due  to  low 
costs  and  acceptance  in  our  culture 
(businesses,  mass  media,  and  personal  rela¬ 
tionships  all  depend  on  the  Internet).  Through 
email  (for  business  and  personal  use),  chat 
(mainly  personal  communication)  and  the  World 
Wide  Web  (businesses  have  embraced  it  and 
the  near  limitless  amalgam  of  topics  available 
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on  it)  the  Internet  has  a  niche  for  anyone  who 
has  the  time  to  spend  on  it.  Email,  chat  and  the 
web  are  examples  of  applications  used  on  the 
Internet  whose  nature  has  addictive  properties 
[17].  Basically,  the  Internet  itself  is  not  addictive, 
but  the  services  available  on  the  Internet  are. 
Young  found  that  interactive  “real  time”  services 
such  as  Internet  Relay  Chat  (live  chat  with  other 
IRC  users  in  chat  rooms,  socializing  and  dis¬ 
cussing  common  topics)  and  multi-user  do¬ 
mains  (MUDS  -  text  based  virtual  worlds  where 
users  meet  and  explore,  where  social  interac¬ 
tion  is  required)  proved  to  be  most  addictive. 
The  use  of  IRC  was  examined  by  Peris  [11], 
and  it  was  found  that  frequent  users  of  IRC 
“find,  in  online  chats,  a  media  for  rich,  intense, 
and  interesting  experiences”  while  “they  con¬ 
sider  online  relationships  as  real  as  face  to  face 
relationships”.  In  another  study  by  Moody  [8],  it 
was  found  that  high  internet  use  (on  IRC  or 
email)  is  associated  with  high  emotional  loneli¬ 
ness.  Users  will  eventually  spend  all  their  time 
online  and  choose  not  to  interact  in  real  life 
physical  social  settings.  Jacobson  [6]  re¬ 
searched  MUDS  users  and  found  that  "users 
participate  in  rewarding  activities  that  allow 
them  to  use  their  skills  and  knowledge  in  the 
challenges  of  these  virtual  worlds”  and  “people 
become  absorbed  in  the  activities  and  relation¬ 
ships  that  occur  in  them”.  When  examined  as 
an  addictive  substance,  applications  such  as 
IRC  and  MUDS  can  be  used  to  “withdraw  or 
escape  from  negative  evaluations  and  the 
stress  of  interpersonal  relationships”  [2],  This 
results  in  loss  of  control  over  time  spent  on  the 
Internet,  leading  to  problems  in  school,  relation¬ 
ships,  finances,  occupation,  and  health  [17]. 
Users  who  tried  to  cut  back  the  time  they  spent 
on  the  Internet  to  avoid  these  addiction-related 
problems  could  not.  Even  those  who  threw  out 
their  modems  could  not  resist  the  urge  of  buying 
new  modems  to  get  back  on  the  Internet  [17]. 
Young  concluded  that  users  do  become  ad¬ 
dicted  and  that  there  is  a  potential  for  more  ad¬ 
dictive  applications  in  the  future. 

MUDS  introduced  interactive  online  role-playing 
games  to  the  Internet,  but  as  technology  ad¬ 
vanced,  so  did  this  genre  of  games.  With  the 
availability  of  3D  graphics  in  games,  it  became 
possible  to  build  three  dimensional  (3D)  visual 
representations  of  the  once  text-only  MUDS. 
Now,  users  are  able  to  see  and  interact  with 
others  in  their  3D  virtual  worlds.  These  mas¬ 


sively  multiplayer  online  role  playing  games 
(MMORPG’s),  such  as  “Everquest”,  “Ultima 
Online”  and  “Diablo  II”  have  been  categorized 
as  “heroinware”  by  many  of  its  users,  as  they 
contain  all  of  the  addictive  elements  of  IRC  and 
MUDS.  MMORPGs,  which  are  run  in  real  time, 
feature  social  and  competitive  aspects,  making 
devotion  to  the  game  mandatory.  If  you  are  not 
playing  online,  you  are  probably  falling  behind. 
While  traditional  videogames  end  at  some  point 
or  become  repetitive  and  boring,  MMORPGs 
are  endless,  because  the  main  feature  of 
MMORPGs  is  its  system  of  goals  and  achieve¬ 
ments.  As  you  play,  your  character  advances  by 
gaining  experience  points  “leveling  up”  from  one 
level  to  the  next,  while  collecting  valuables  and 
weapons  -  becoming  wealthier  and  stronger. 
This  system  creates  an  online  “life”  for  your 
character  and  if  you  die,  the  penalty  is  a  deduc¬ 
tion  of  experience  points.  Social  interaction  in 
MMORPGs  is  highly  essential,  as  you  must  col¬ 
laborate  with  other  players  in  the  game  to  suc¬ 
ceed  in  more  complex  goals.  Eventually,  a 
player  must  join  a  “guild”  or  “clan”  of  other  play¬ 
ers  to  advance  further  in  the  game.  Finding 
other  players  in  the  game  “Everquest”  is  not 
hard,  as  there  are  433,445  active  players  world¬ 
wide  including  the  12,000  new  players  every 
month,  each  paying  $12-$40  a  month  for  ac¬ 
cess  to  the  game  [13]. 

Everquest  (or  Evercrack,  as  many  players  have 
nicknamed  it)  is  a  fantasy  game,  based  on  con¬ 
cepts  similar  to  the  work  of  Tolkien’s  Middle 
Earth  and  Dungeons  and  Dragons,  and  is  the 
most  popular  of  all  MMORPGs.  Because  of  its 
popularity,  Everquest  has  received  the  most 
press  and  the  most  blame  for  MMORPG  addic¬ 
tion.  In  a  recent  News.com  article  [1],  one  re¬ 
covering  Everquest  player  was  quoted,  “The 
game  almost  ruined  my  life,  it  was  my  life.  I 
ceased  being  me;  I  became  Madrid,  the  Great 
Shaman  of  the  North.  Thinking  of  it  now,  I  al¬ 
most  cringe;  it’s  so  sad.”  The  same  article  de¬ 
scribes  players  who  have  lost  their  jobs  and 
even  marriages  due  to  overuse  of  Everquest. 
Another  player  explained  his  addiction,  “I’d  say 
the  most  addictive  part  for  me  was  definitely  the 
gain  of  power  and  status,  the  way  in  which  as 
you  progressively  gain  power  you  become  more 
of  an  object  of  awe  to  other  players...  each  new 
skill  isn’t  enough”  [1].  In  a  Time  [13]  article,  De¬ 
nise  Dituri,  a  mother  of  three,  who  had  no  inter¬ 
est  in  fantasy  games,  became  an  18  hour  a  day 
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player  in  Everquest.  But  instead  of  ruining  her 
family,  the  game  has  seemingly  brought  them 
closer  together.  Denise  and  her  husband  Gary 
play  Everquest  with  their  three  children,  viewing 
the  game  as  an  activity  of  the  mind,  and  as  an 
alternative  to  television.  Gary  confesses  that  he 
has  learned  more  about  his  son  than  ever  be¬ 
fore  while  playing  Everquest.  Even  the  topic  of 
dinner  conversation  in  the  Dituri  household  is 
over  what  happened  while  they  were  in  Ever¬ 
quest. 

Young  [17]  provided  research  that  certain  users 
become  addicted  to  specific  applications  used 
on  the  Internet.  Griffiths  [4]  concluded  the  same, 
with  results  showing  that  addicts  are  usually 
addicted  to  online  chat  or  fantasy  role-playing 
games  (MUDS).  Griffiths  also  emphasized  that 
these  applications  allowed  users  an  anonymity 
allowing  them  to  create  their  own  social  identi¬ 
ties,  raising  the  users’  self-esteem.  It  is  this  ano¬ 
nymity  that  gives  those  with  low  self  confidence 
and  sub-par  social  skills  the  desire  to  create  a 
virtual  life  for  themselves  on  the  Internet.  In 
these  cases,  the  Internet  becomes  a  substitute 
for  real  life  social  interaction,  giving  the  user  an 
escape  from  reality  [18].  In  the  early  90’s  the 
Internet  addict  was  stereotyped  as  a  male  com¬ 
puter  hobbyist,  but  recent  research  proves  that 
anyone  can  become  addicted,  as  it  is  a  combi¬ 
nation  of  personality  type  and  Internet  applica¬ 
tion  that  causes  overuse  leading  into  addiction. 

MATERIALS  AND  METHODS 

In  this  study,  a  comparison  will  be  made  be¬ 
tween  online  MMORPG  game  users  and  offline 
video  game  users,  to  find  elements  that  differ¬ 
entiate  the  two  types  of  users  and  factors  that 
contribute  to  overuse.  It  is  proposed  that  factors 
which  cause  Internet  overuse  are  similar  to 
those  that  cause  MMORPG  overuse. 

The  evaluations  took  place  online  in  the  form  of 
two  surveys  which  served  to  compare  the  two 
types  of  users.  The  surveys  are  based  on  a  sur¬ 
vey  developed  in  1 999  by  Pratarelli  et  al.  in  their 
paper  “The  bits  and  bytes  of  computer/Internet 
addiction:  a  factor  analytic  approach”  [9]. 
Pratarelli’s  survey  focused  on  variables  indica¬ 
tive  of  both  computer  and  Internet  use  and  was 
devised  to  gather  data  on  the  behavioral  pat¬ 
terns  of  heavy  Internet  users.  This  survey  has 
been  modified  to  explore  the  individuals  who 


are  primarily  MMORPG  or  video  game  players 
(respectively,  online  and  offline  game  players). 
To  facilitate  the  comparison  study,  the  same 
survey  was  used  for  the  testing  of  both  user 
groups,  with  the  exception  of  the  terms 
“MMORPG”  and  “video  games”.  These  two 
terms  were  replaced  in  the  context  of  its  respec¬ 
tive  test;  this  preserved  the  questions  yet 
changed  the  context.  The  survey  questions 
were  collected  anonymously  through  an  online 
survey  which  was  advertised  on  various  gaming 
forums  hosted  on  well  known  gaming  sites 
eqvault.ign.com,  www.everlore.com  and 
www.fohguild.org.  After  10  days,  the  surveys 
were  taken  offline.  No  rewards  were  offered  to 
those  who  volunteered  to  participate.  Questions 
are  generalized  so  that  any  sample  user  from 
the  general  population  who  has  played 
MMORPG’s  or  video  games  can  answer.  If  a 
user  were  primarily  a  MMORPG  player,  they 
were  asked  to  complete  the  MMORPG  survey, 
and  similarly  for  video  game  users. 

Individual  survey  items  gathered  data  on  demo¬ 
graphic  information,  game  usage  patterns,  so¬ 
cial  behaviors  of  users,  and  the  user’s  game 
purchasing  habits.  Demographic  information 
collected  was  gender,  educational  level,  profes¬ 
sional  level,  hours  per  week  spent  playing 
games,  and  time  of  day  spent  playing.  All  re¬ 
maining  questions  were  Likert  scaled  re¬ 
sponses;  users  were  asked  to  rank  their  agree¬ 
ment  or  disagreement  to  each  question  on  a 
scale  from  1  to  5.  Game  usage  questions  fo¬ 
cused  on  how  much  time  users  were  spending 
on  games,  how  long  a  typical  session  would 
last,  if  usage  time  affected  their  daily  schedules, 
and  measured  for  indications  of  spending  too 
much  time  using  games.  Social  behavior  ques¬ 
tions  collected  data  on  dependence,  compan¬ 
ionship,  self-image,  and  attitude  of  the  user 
while  gaming.  Lastly,  users  answered  questions 
about  their  game  purchasing  habits. 

RESULTS 

The  MMORPG  survey  demographics  had  a  total 
of  91  responses.  88%  of  those  were  male,  44% 
had  a  high  school  degree  and  29%  had  a 
bachelor’s  degree.  37%  were  students  while 
53%  worked  as  full-time  employees.  When 
asked  how  many  hours  a  week  they  spend  on 
MMORPG’s,  13%  spent  between  7-10  hours, 
25%  spent  11-20  hours,  34%  spent  21-40  hours 
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and  11%  spent  40+  hours  playing  a  week.  82% 
played  during  the  hours  of  6pm-1 1pm. 

Demographic  data  for  video  game  users  was 
quite  similar  to  MMORPG  users,  as  expected. 
48  responses  were  reported,  and  of  those,  71% 
were  male.  25%  had  a  high  school  degree  and 
54%  had  a  bachelor’s  degree.  29%  were  stu¬ 
dents  and  71%  were  full-time  employees.  In 
contrast  to  the  hours  spent  playing  per  week, 
video  game  users  spent  significantly  less  time 
playing  their  games  per  week.  38%  played  for 
1  -2  hours  a  week,  35%  spent  3-6  hours  and  6% 
spent  7-10  hours  a  week.  87%  played  during 
the  hours  of  6pm-11pm,  which  was  similar  to 
the  MMORPG  players. 

Likert  scaled  questions  on  game  usage  pat¬ 
terns,  social  behaviors  of  users,  and  game  pur¬ 
chasing  habits  were  analyzed  with  an  unpaired 
t-test  for  significance  between  the  two  groups 
test  results.  According  to  the  data  on  game  us¬ 
age  patterns,  6  of  the  questions  on  showed  a 
high  significance  (P=0.0001),  2  showed  some 
significance  and  2  did  not  have  any  signifi¬ 
cance.  MMOPRG  players  had  tendencies  of 
playing  for  8  continuous  hours,  losing  sleep  be¬ 
cause  of  playing,  and  have  been  told  they 
spend  too  much  time  playing.  All  questions 
which  suggested  heavy  overuse  were  domi¬ 
nated  by  the  MMOPRG  users.  Social  behaviors 
of  users  varied  for  the  two  groups,  as  signifi¬ 
cance  was  found  in  50%  of  the  questions  in  this 
category.  MMORPG  users  would  rather  spend 
time  in  the  game  than  with  friends,  have  more 
fun  with  in-game  friends  than  people  they  know, 
found  it  easier  to  converse  with  people  while  in¬ 
game,  did  not  find  social  relationships  as  impor¬ 
tant,  and  felt  happier  when  in  the  game  than 
anywhere  else.  Offline  game  users  had  sought 
out  video  games  to  alleviate  depression  at 
times,  while  MMORPG  users  didn’t.  However, 
neither  group  used  games  as  a  diversion  from 
loneliness  or  to  gain  self-confidence.  Spending 
on  games  between  both  groups  showed  no  sig¬ 
nificance,  as  neither  group  had  any  monetary 
issues  associated  with  gaming. 

DISCUSSION 

The  findings  confirm  the  background  that  has 
been  presented  and  highlights  the  differences 
between  the  two  groups.  It  is  clear  that 
MMORPG  users  have  a  tendency  to  spend 


many  more  hours  devoted  to  their  game  and 
find  the  social  aspects  of  the  in-game  world 
more  pleasant  and  satisfying  than  what  occurs 
in  the  real  world.  However,  MMORPG  users 
don’t  seek  self-confidence  in-game,  would  find 
fun  elsewhere  if  MMORPG’s  didn’t  exist,  and 
would  not  feel  irritated  if  they  didn’t  have  the 
chance  to  play  for  one  day.  This  would  suggest 
that  as  much  as  MMORPG  users  enjoy  the  time 
they  spend  in-game,  even  more  so  than  real  life 
activities  with  friends,  they  are  not  addicted.  I 
would  propose  that  MMOPRG  users  have  a 
different  perspective  on  social  life,  which  could 
be  labeled  as  anti-social  or  introverted  by  most, 
and  as  such  choose  to  spend  their  social  time 
and  energy  in-game  rather  than  socializing  in 
the  real  world.  It  is  because  of  the  social  as¬ 
pects  inherent  in  MMORPG’s  that  draws  in  the 
“hard-core"  players  who  show  patterns  of  addic¬ 
tion.  For  most  users  it  would  seem  that 
MMORPG’s  are  an  alternative  to  other  forms  of 
social  entertainment.  If  MMORPG’s  weren’t 
available  or  didn’t  exist,  these  same  users 
wouldn’t  seek  friends  or  social  situations  such 
as  parties,  bars  or  clubs,  but  perhaps  other 
forms  of  socializing  online  in  the  form  of  emails, 
chat  rooms  or  instant  messenger.  Since  it  is 
apparent  that  most  users  are  not  addicted,  but 
rather  choosing  to  spend  their  time  on 
MMORPG’s,  determining  how  they  spend  their 
time  in-game  could  explain  their  attraction  to  the 
games.  For  future  study,  these  social  aspects 
and  in-game  activities  could  be  explored  in- 
depth.  In  conclusion,  it  is  the  social  aspects  that 
exist  in-game  that  draw  users  into  MMORPG’s. 
Much  like  users  who  are  addicted  to  the  Inter¬ 
net,  they  seek  social  experiences  which  are  not 
available  elsewhere  in  their  lives.  Even  with 
high  usage  times,  MMORPG  users  cannot  be 
categorized  as  addicted,  because  they  do  not 
exhibit  the  behaviors  of  addicts. 
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Everyday  life  requires  us  to  locate  places  in  our 
environment  and  navigate  them  efficiently.  One 
brain  structure  that  is  essential  for  normal  navi¬ 
gation  is  the  hippocampus.  Coincidently,  the 
hippocampus  is  a  metabolically  fragile  structure, 
and  is  often  damaged  as  the  result  of  a  variety 
of  psychiatric  conditions,  including  Alzheimer’s 
disease,  epilepsy,  post-traumatic  stress  disor¬ 
der,  and  schizophrenia.  For  example,  it  has 
been  shown  that  individuals  with  schizophrenia 
have  smaller  hippocampi  than  age-matched 
controls,  and  neuronal  pathology  exist  within 
their  hippocampi.  By  using  VR  during  functional 
brain  imaging,  we  can  examine  the  extent  to 
which  individuals  with  schizophrenia  utilize  their 
hippocampus  while  they  are  navigating  through 
virtual  environments. 

Twelve  individuals  with  schizophrenia  and  ten 
age-matched  controls  were  tested  on  a  virtual 
Morris  water  task  in  a  functional  magnetic  reso¬ 
nance  imaging  (fMRI)  paradigm.  Participants 
were  virtually  placed  in  a  round  pool  and  had  to 
locate  a  hidden  goal  area.  The  virtual  environ¬ 
ment  was  created  using  3D  Game  Studio,  and 
was  shown  via  an  LCD  projector  on  a  screen 
that  the  patients  viewed  using  45-degree  mirror 
glasses  while  lying  supine  in  the  MRI  scanner. 
The  participants  navigated  through  the  pool  to 
find  the  hidden  platform  using  a  MRI-compatible 


joystick.  Sixteen  slices  were  obtained  in  the  cor¬ 
onal  oblique  plane  perpendicular  to  the  long 
axis  of  the  hippocampus  using  a  GE  Signa  1.5T 
MRI  system. 

The  results  indicate  that  the  individuals  with 
schizophrenia  displayed  impairments  in  navigat¬ 
ing  to  the  goal  area  compared  to  the  age- 
matched  control  participants.  By  examining  the 
brain  structures  used  during  virtual  navigation, 
we  note  that  the  control  participants  have  sig¬ 
nificant  hippocampus  involvement  during  virtual 
navigation,  whereas  the  individuals  with  schizo¬ 
phrenia  do  not.  We  also  note  that  the  individuals 
with  schizophrenia  have  different  patterns  of 
activation  in  the  cingulate  cortex,  insular  cortex, 
and  left  middle  frontal  gyrus  relative  to  control 
participants. 

Hence,  it  appears  that  individuals  with  schizo¬ 
phrenia  do  not  use  their  hippocampus  during 
navigation  to  the  same  extent  as  controls.  It  is 
not  immediately  clear  whether  this  difference  is 
due  to  the  patients  being  unable  to  use  their 
hippocampus  normally  (i.e.  They  have  a  dys¬ 
functional  hippocampus,  and  it  can’t  work  nor¬ 
mally)  or  whether  other  factors  such  as  low  mo¬ 
tivation  may  have  caused  the  patient  group  to 
use  a  non-spatial  strategy  (i.e.  They  have  a  nor¬ 
mal  hippocampus,  but  were  using  a  strategy 
that  would  not  activate  it).  Additional  analyses 
and  experiments  are  underway  to  disambiguate 
these  two  hypotheses. 

Our  research  is  unique  in  that  we  use  VR  to 
investigate  the  brain  processes  involved  in  navi¬ 
gation  in  an  fMRI  paradigm  that  requires  immo¬ 
bility  of  the  participant’s  head.  This  task  is  ideal 
because  it  is  a  virtual  analogue  of  a  common 
rodent  task  called  the  Morris  water  task.  Given 
that  the  hippocampus  is  damaged  in  a  variety  of 
psychiatric  and  neurological  illnesses,  it  allows 
us  to  use  a  single  task  across-species  to  moni¬ 
tor  hippocampus  functioning  as  well  as  the  effi¬ 
cacy  of  pharmaceutical  and  behavioral  thera¬ 
pies  aimed  at  improving  memory  function. 
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Virtual  Reality  (VR)  is  a  useful  tool  in  the  field  of 
psychology,  but  its  applications  have  mainly 
centered  on  its  utility  as  a  therapeutic  tool.  How¬ 
ever,  VR  could  also  be  very  helpful  for  basic 
research.  It  allows  researchers  to  present  stim¬ 
uli  and  to  register  responses  in  a  controlled 
manner  and  in  an  environment  that  “simulates 
the  reality"  (Banos  et  al.,  1999;  Botella,  et  al., 
1998).  The  experimental  paradigms  used  to 
study  cognitive  processes  in  mental  disorders 
have  had  to  sacrifice  ecological  validity  in  favor 
of  internal  validity.  Examples  of  these  para¬ 
digms  in  the  study  of  attentional  processes  are 
the  “dote  probe  task”  and  the  “emotional  Stroop 
task”.  Both  tasks  try  to  demonstrate  that  per¬ 
sons  with  anxiety  disorders  preferentially  direct 
their  attention  towards  threatening  stimuli  (e.g., 
Williams,  Watts,  MacLeod,  &  Mathews,  1997). 

Words  or  photographs  with  different  emotional 
weight  are  presented  to  the  participants,  and 
the  performance  of  people  with  anxiety  disor¬ 
ders  and  individuals  without  these  problems  are 
compared.  However,  both  words  and  photo¬ 
graphs  are  static  stimuli,  presented  in  two  di¬ 
mensions,  and  lacking  any  context.  Therefore,  if 
the  aim  of  the  clinician  is  to  understand  how  a 
person  with  a  specific  phobia  directs  their  atten¬ 
tion  in  a  feared  situation,  a  more  reliable  result 
would  come  from  assessing  his  or  her  atten¬ 
tional  performance  in  that  situation,  in  contrast 
to  the  presentation  of  words  or  drawings.  Obvi¬ 
ously,  there  would  be  notable  difficulties  regard¬ 
ing  internal  validity  if  the  situations  took  place  in 
real  life,  since  a  total  control  would  not  be  possi¬ 
ble,  but  this  problem  could  be  minimized  in  a 
VR  laboratory  where  the  stimuli  could  be  pre¬ 
sented  in  a  controlled  manner.  Moreover,  the 
presentation  of  the  stimuli  could  also  be  done 
outside  the  conscious  awareness  of  the  individ¬ 


ual  by  jointly  using  subliminal  perception  strate¬ 
gies.  In  this  sense,  VR  allows  us  to  study  an 
issue  that  is  difficult  to  grasp  in  the  real  world. 

In  order  to  study  the  feasibility  of  VR  as  a 
“realistic”  laboratory  where  attentional  proc¬ 
esses  in  specific  phobia  (spiders  and  cock¬ 
roaches)  can  be  studied,  our  team  has  devel¬ 
oped  an  environment  where  a  house  is  simu¬ 
lated  and  a  version  of  the  dote-probe  task  has 
been  introduced.  The  person  has  to  explore  this 
environment  and  find  several  keys  that  appear 
during  a  brief  period  of  time.  When  they  are  de¬ 
tected,  the  individual  has  to  press  the  bottom  of 
the  mouse  so  the  computer  can  register 
whether  the  response  is  correct  and  complete 
within  the  time  required  to  make  the  decision. 
The  computer  controls  the  presentation  of  the 
stimuli  and  its  exact  location.  The  keys  appear 
in  the  same  location  just  after  a  threatening 
stimulus  (spider  or  cockroach)  or  a  neutral 
(watch)  is  presented. 

First,  the  keys  are  presented  after  a  series  of 
randomized  subliminal  presentations  of  the  spi¬ 
der/cockroach  and  the  watch.  After  a  break, 
during  which  the  person  stays  immersed  in  the 
virtual  world,  he  or  she  is  asked  to  find  pad¬ 
locks,  which  appear  in  the  same  way  described 
for  the  keys  (but  the  stimuli  are  presented  in  a 
supraliminal  way).  The  differences  between 
groups  (phobics  and  non-phobics)  and  within 
the  groups  will  be  analyzed.  In  the  present 
work,  the  VR  scenarios  and  the  experimental 
tasks  are  described. 
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Fifteen  cigarette  smokers  participated  in  a  study 
of  the  ability  of  smoking  cues  within  a  virtual 
world  to  provoke  craving-to-smoke.  Subjects 
were  asked  to  abstain  from  smoking  for  at  least 
12  hours  prior  to  testing,  confirmed  by  CO 
analysis  of  expired  breath,  and  then  completed 
a  questionnaire  concerning  their  smoking  his¬ 
tory. 

Subjects  were  seated  in  front  of  a  21 -inch  color 
monitor  and  given  a  short  practice  session. 
Then  they  were  placed  in  a  VR  simulation  that 
did  not  contain  any  intentional  smoking  stimuli 
and  were  instructed  to  explore  a  sequence  of 
environments  with  occasional  directions  from 
the  experimenter.  At  various  points  during  the 
simulation,  the  experimenter  brought  up  a  rating 
scale,  and  the  subjects  were  asked  to  rate  their 
urge  to  smoke  on  a  scale  of  0-1 00. 

In  the  second  run  various  smoking  stimuli  were 
placed  in  the  simulation  at  strategic  locations 
that  the  subject  would  likely  encounter.  These 
stimuli  included  opened  packs  of  cigarettes, 
lighters,  ashtrays,  advertisements,  cigarette 
vending  machines,  cigarette  cartons  for  sale, 
characters  smoking  and  a  bar  scene.  Once 
again,  subjects  were  asked  to  rate  their  urge  to 
smoke  at  various  points  during  the  simulation. 

Each  run  lasted  approximately  10-15  minutes. 
The  rating  data  was  automatically  saved  to  an 
Excel  spreadsheet.  An  overall  change-in¬ 
craving  score  between  runs  was  computed  for 
each  subject.  Despite  a  nearly  identical  mean 
rating  at  the  beginning  of  each  run,  the  results 
showed  a  1 5.7  mean  increase  in  urge  to  smoke 
between  runs.  Thus,  the  embedded  smoking 
stimuli  provoked  a  highly  significant  increase  in 


craving  between  the  two  runs  (p<0.00014  one- 
tailed  paired  t-test). 

Six  subjects  with  the  highest  differential  rating 
between  runs  were  recruited  to  participate  in  an 
fMRI  pilot  study  several  weeks  later  using  a  Sie¬ 
mens  3T  Allegra  scanner.  Four  subjects  were 
smoking-deprived  for  at  least  12  hours  prior  to 
the  scan,  and  two  were  allowed  to  smoke  as 
usual.  Each  subject  participated  in  two  runs, 
one  without  smoking  stimuli  and  one  with  smok¬ 
ing  stimuli.  Echo  planar  imaging  data  from  the 
two  runs  were  combined  and  differences  be¬ 
tween  and  within  the  runs  were  studied. 

Individual  analyses  showed  activation  of  normal 
sensory  (visual,  sensorimotor)  and  motor  areas, 
indicating  that  the  imaging  technique  could  de¬ 
tect  normal  activation  in  these  subjects.  Addi¬ 
tionally,  the  individual  analyses  revealed  clear 
and  highly  significant  activation  of  multiple  ar¬ 
eas  previously  reported  involved  in  drug  craving 
and  cigarette  smoking.  In  the  deprived  smokers 
there  was  highly  significant  activation  in  the 
amygdala  (2  subjects),  hippocampus  (1),  pre¬ 
frontal  cortex  (3),  parietal  association  areas  (2), 
and  inferior  rectus  gyrus  (2).  In  addition  there 
was  highly  significant  deactivation  in  wide¬ 
spread  areas,  especially  of  the  frontal  lobes  bi¬ 
laterally.  In  comparison  there  were  no  areas  of 
significant  cortical  deactivation  in  the  two  control 
smokers,  who  were  allowed  to  smoke  right  up 
until  the  fMRI  study  began. 

This  study  demonstrates  that  both  self-report 
and  physiological  data  indicate  that  appropriate 
VR  simulations  can  be  used  to  manipulate  crav¬ 
ing  in  addicted  smokers. 
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Research  Status:  Preliminary  completed  clini¬ 
cal  trial 

Background: 

Drug  related  stimuli/cues  (cigarettes,  other  peo¬ 
ple  smoking)  have  the  ability  to  elicit  both 
physiological  and  behavioral  reactions  e.g., 
craving  in  nicotine  dependent  cigarette  smok¬ 
ers.  Traditional  cue  exposure  methods  involve 
bringing  smokers  into  austere  laboratory  envi¬ 
ronments  and  using  videos,  still  pictures,  and 
paraphernalia  to  elicit  craving  and  physiological 
reactivity.  While  these  methods  have  led  to 
craving  and  physiological  reactivity,  their  gener- 
alizability  outside  of  the  lab  and  utility  in  clinical 
setting  remains  in  question.  Thus,  a  virtual  real¬ 
ity  cue  exposure  (VRCE)  environment  was  de¬ 
veloped  to  test  the  reactivity  of  nicotine  depend¬ 
ent  cigarette  smokers  to  virtual  cues.  VRCE 
combines  the  elements  of  VR  with  specific  in¬ 
animate  smoking  cues,  environments,  social 
interactions,  and  other  related  stimuli  in  a  virtual 
environment  appropriate  for  laboratory  and  clini¬ 
cal  settings.  VRCE  combines  both  computer 
generated  and  video  images  depicting  smoking 
cues  (e.g.  cigarette  packages,  ash  trays,  burn¬ 
ing  cigarettes)  and  smoking  social  interactions 
(e.g.  being  offered  a  cigarette  in  a  social  con¬ 
text).  VRCE  expands  traditional  cue  exposure 
methods  by  allowing  participants  to  experience 
“real  world”  smoking  situations  in  a  controlled 
VR  setting.  After  development  and  beta  testing, 
the  VRCE  environment  was  tested  in  a  clinical 
trial  with  nicotine  dependent  cigarette  smokers. 

Methods: 

20  male  and  female  nicotine  dependent  smok¬ 
ers  participated  in  the  VRCE  clinical  trial.  After  a 
20-minute  deprivation  period,  cigarette  smokers 
were  exposed  to  both  VR  neutral  stimuli  and  VR 
smoking  related  stimuli  using  a  VFX-3D  HMD 
(Interactive  Imaging,  Rochester,  NY)  connected 
to  a  2Ghz  P-IV  PC.  The  presentation  order  of 
inanimate  and  animate  stimuli  was  counterbal¬ 
anced  to  control  for  the  total  time  in  VR.  In  addi¬ 


tion,  a  Coulbourn  Lab  Line  V  system 
(Coulbourn,  Inc.  City,  State)  was  used  to  meas¬ 
ure  heart  rate,  Skin  Conductance  Level,  and 
respiration  during  VRCE  sessions.  We  hypothe¬ 
sized  that  smokers  who  are  exposed  to  VR 
smoking  related  cues/stimuli  will  have  greater 
physiological  reactivity  (heart  rate,  respiration, 
and  skin  conductance)  and  will  report  increases 
in  subjective  urges  and  craving  compared  to  VR 
neutral  cues/stimuli. 

Results: 

Twenty  cigarette  smokers  participated  in  the  clini¬ 
cal  trial.  Participants  smoked  at  least  21  cigarettes 
per  day,  experienced  craving,  and  were  in  good 
physical  health.  Comparisons  were  made  on  both 
craving  and  physiological  measures  between  the 
smoking  and  neutral  cue  rooms.  Data  will  be  pre¬ 
sented  for  all  clinical  variables  including  subjective 
craving  reports  and  physiological  data. 

Conclusions: 

The  demonstration  of  reactivity  in  smokers  to 
VR  smoking  cues  provides  a  foundation  to  de¬ 
velop  additional  VR  environments  and  test 
VRCE  in  clinical  treatment  studies  for  efficacy. 

Novelty/discussion: 

This  is  the  first  VR  program  in  addictions  to  in¬ 
corporate  neutral,  inanimate,  and  animate  envi¬ 
ronments  that  utilize  realistic  video  images  and 
allow  participants  to  interact  with  people  instead 
of  computer-animated  avatars,  arguably  produc¬ 
ing  more  realistic  interactions.  VRCE  offers  a 
new  medium  for  both  clinicians  and  researchers 
who  work  with  addictions  to  bring  cue  exposure 
into  the  treatment  setting.  The  VRCE  program 
will  lead  to  significant  advances  in  understand¬ 
ing  craving  and  other  clinical  phenomenon  that 
may  lead  to  relapse  in  cigarette  smokers. 

This  research  was  supported  by  NIDA  Grant  #1- 
R41-DA01 6085-01.  Authors  also  thank  the  staff 
at  Coulbourn  instruments  for  their  support  in 
collecting  physiological  data. 
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Phobias  are  one  of  the  most  common  psychiat¬ 
ric  disorders.  It  is  estimated  that  about  1 1  %  of 
the  population  suffers  from  a  specific  phobia 
(Magee,  Eaton,  Wittchen,  McGonagle  & 
Kessler,  1996).  Currently,  in  vivo  exposure  is  a 
very  effective  procedure  available  for  the  treat¬ 
ment  of  phobias  (Nathan  &  Gorman,  1998, 
2002).  However,  it  is  estimated  that  only  1 5%  of 
phobics  seek  treatment  (Boyd  et  al.,  1990). 
Moreover,  many  persons  who  are  referred  to 
receive  treatment  do  not  receive  it  due  to  a  lack 
of  adequately  trained  professionals.  Because  of 
this,  we  think  that  it  is  important  to  develop 
strategies  that  increase  the  availability,  attrac¬ 
tiveness,  and  acceptance  of  treatment  for  pho¬ 
bias.  Making  the  treatment  easily  available  can 
be  a  good  way  to  achieve  these  objectives. 

Some  studies  have  already  been  done  that  ex¬ 
plore  the  possibility  of  using  the  Internet  to  pro¬ 
vide  help.  The  Internet  has  been  used  to  reduce 
risk  factors  for  eating  disorders  (Winzelberg, 
Eppstein,  Eldredge  &  Winfley,  2000;  Celio, 
Winzelberg,  Wilfley,  Eppstein,  Springer,  Dev  & 
Taylor,  2000),  to  apply  treatment  for  recurrent 
headaches  (Strom,  Petterson  &  Anderson, 
2000),  and  to  apply  a  program  for  posttraumatic 
stress  disorder  (Lange  et  al.,  2000).  However, 
there  is  only  one  study  carried  out  by  our  own 
group  in  which  the  whole  treatment  is  totally 
available  on  the  Internet,  including  the  feared 
scenarios  to  apply  exposure,  where  the  partici¬ 
pation  of  the  therapist  is  not  required.  It  is  there¬ 
fore  a  completely  self-applied  program  (Botella, 
et  al,  2000;  Botella,  Banos,  Guillen,  Perpina, 
Garcfa-Palacios,  Alcaniz,  &  Pons,  2001).  This 
study  is  about  public  speaking  fears,  and  the 
feared  scenarios  consist  of  real  videos  with 
threatening  audiences  for  people  who  have  this 
problem. 


In  the  present  study,  a  telepsychology  system 
that  uses  Internet  for  the  treatment  of  animal 
phobias  is  presented.  The  program  allows  a 
step-by-step  self-application  of  the  treatment, 
controlled  by  the  system  itself  without  any  con¬ 
tact  between  patient  and  therapist.  The  system 
is  composed  of:  a)  an  assessment  protocol  that 
gives  the  patient  a  diagnosis  of  his  or  her  prob¬ 
lem,  including  the  interference  it  is  causing  him 
or  her,  its  severity,  and  the  degree  of  fear  and 
avoidance  it  is  producing;  b)  a  structured  treat¬ 
ment  protocol,  organized  in  separate  blocks 
reflecting  the  patient’s  progress.  In  this  way  it  is 
possible  to  ensure  that  the  patient  does  not  skip 
any  steps  in  the  treatment  (a  common  problem 
with  traditional  self-help  manuals),  gaining  more 
control  over  the  process;  and  c)  an  outcome 
protocol  that  assesses  treatment  effectiveness 
at  every  intermediate  step  as  well  as  at  the  end 
of  treatment. 

The  results  obtained  in  a  case  series  analysis 
with  15  participants  are  presented.  These  indi¬ 
cate  the  benefit  of  continuing  to  work  to  develop 
effective  treatments,  which  are  increasingly 
available  to  the  patient.  This  means  a  notable 
advance  in  therapeutic  cost-benefit.  The  combi¬ 
nation  of  new  technologies  together  with  self- 
help  material  seems  to  be  a  promising  alterna¬ 
tive  that  can  help  to  solve  some  existing  prob¬ 
lems  in  the  field  of  mental  health. 
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Context: 

In  previous  studies,  we  have  observed  that 
anxiety  and  presence  are  correlated.  The  pur¬ 
pose  of  this  study  is  to  explore  this  relationship 
in  order  to  understand  the  direction  of  the 
causal  relationship  between  presence  and  emo¬ 
tions  felt  in  VR.  Our  hypothesis  was  that  in¬ 
creases  in  anxiety  would  lead  to  a  stronger 
sense  of  presence. 

Method: 

The  sample  consisted  of  26  women  aged  be¬ 
tween  27  and  68  years  old  (M  =  45,23;  SD  = 
11,35)  and  5  men  aged  between  32  and  56 
years  old  (M  =  43.60;  SD  =  10,02).  The  sub¬ 
jects  were  first  SCID-diagnosed  to  confirm  the 
presence  of  snake  phobia  and  randomly  as¬ 
signed  to  one  of  two  conditions.  The  design 
was  a  randomized  repeated  measures  ANOVA 
with  three  subsequent  immersions  (a  control 
immersion  [CTRL  environment]  and  two  experi¬ 
mental  immersions)  and  two  conditions:  (a)  a 
VR  immersion  in  an  environment  «filled>>  with 
hidden  snakes,  which  should  induce  anxiety 
(ANX  environment),  and  (b)  a  VR  immersion  in 
the  same  environment  as  in  (a)  but  without  any 
hidden  snakes,  which  should  not  induce  any 
anxiety  (NOANX  environment).  In  the  NOANX 
environment,  participants  were  immersed  in  a 
virtual  environment  depicting  a  desert  with  pyra¬ 
mids  and  temples.  They  were  asked  to  visit  it  for 
five  minutes  and  were  told  that  the  environment 
was  safe  and  contained  no  snakes.  In  the  ANX 
environment,  participants  were  immersed  in  the 
exact  same  environment  and  had  to  perform  the 
same  task,  but  they  were  led  to  believe  that  the 
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environment  was  plagued  with  hidden  danger¬ 
ous  snakes.  To  sum  up,  participants  in  the  first 
condition  were  immersed  in  the  CTRL  environ¬ 
ment,  then  in  the  ANX  environment  followed  by 
the  NOANX  environment.  For  the  second  con¬ 
dition,  the  sequence  was  immersion  in  the 
CTRL  environment,  in  the  NOANX  environment, 
and  in  the  ANX  environment.  The  immersions 
in  the  ANX  and  NOANX  environments  were 
separated  by  a  distraction  task  consisting  of 
reading  of  a  relaxation  text  and  answering  ques¬ 
tions  about  it.  Each  VR  immersion  was  followed 
by  measures  of  presence  and  anxiety.  At  the 
end  of  the  study,  the  participants  were  trained  to 
use  a  self-help  manual  for  their  phobia  in  com¬ 
pensation  for  their  participation. 

Results  and  conclusion: 

A  manipulation  check  confirmed  that  partici¬ 
pants  were  significantly  more  anxious  in  the 
ANX  environment  than  in  the  other  environ¬ 
ments.  Results  of  the  repeated  measures 
ANOVAs  showed  that  presence  was  higher  in 
the  anxiety  provoking  environment  than  in  the 
control  or  the  non-anxious  environment,  as  con¬ 
firmed  by  the  significant  Condition  by  Time  in¬ 
teractions  and  the  interaction  contrasts  (all  p 
<  .01).  The  results  are  discussed  in  the  light  of 
the  measurement  of  presence  and  the  relation¬ 
ship  between  emotions  and  presence.  It  ap¬ 
pears  that  an  emotion  such  as  anxiety  is  in¬ 
creasing  significantly  the  sense  of  presence  in  a 
virtual  environment.  The  opposite  relationship 
still  has  to  be  tested.  However,  it  suggests  that 
in  addition  to  hardware  and  software  variables, 
people’s  internal  states  are  providing  additional 
cues  to  create  the  sense  of  presence. 
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Background: 

The  question,  what  Virtual  Environments  of  all 


sorts  do  to  their  respective  users,  for  years  was 
reduced  to  investigating  the  various  side-  and 
after-effects  that  these  integrated  systems  may 
cause.  While  these  questions  still  are  not  obso¬ 
lete,  they  are  of  far  less  importance,  due  to 
highly  sophisticated  technological  solutions  to 
the  main  problems  causing  these  side-  and  af¬ 
ter-effects,  like  system  delays,  insufficient  and 
ergonomically  poor  I/O  -  devices,  etc.  Therefore 
the  research  focus  under  the  heading  "What  do 
VE-Systems  do  to  their  users”  shifted  rather 
slowly  towards  performance,  usability,  accep¬ 
tance  and  awareness  issues.  At  the  beginning 
of  such  studies  it  became  obvious  rather 
quickly,  that  when  it  came  down  to  rating,  meas¬ 
uring  and  objectifying,  usually  paper  and  pencil 
-  based  tests  and/or  questionnaires  was  all 
there  was  and  by  and  large  still  is. 

In  contrast,  what  was  needed  were  tools  for  ob¬ 
taining  objective  parameters  from  VE  users,  that 
could 

•  not  be  influenced  voluntarily  by  the  user 

•  be  regarded  as  intra-individually  stable  as 
well  as  inter-individually  comparable 

•  serve  as  “mosaic  stones”  for  more  complex 
psychological  constructs  like  attention,  vigi¬ 
lance,  stress,  etc. 

•  serve  as  performance  indicators  with  re¬ 
spect  to  the  virtual  task 

The  few  solutions  that  were  on  the  market  cov¬ 
ered  only  parts  of  these  requirements  and  most 
of  them  were  not  applicable  within  VEs  and/or 
had  no  real-time  capabilities.  In  addition  to 
these  few  off  the  shelf  systems  there  were  also 
a  few  applications  that  respective  research  labs 
or  groups  custom-tailored  to  their  applications. 

Having  in  mind  the  requirements  as  well  as  the 
shortcomings  of  the  existing  solutions,  in  the 
course  of  the  pan-European  research  project 
“Virtual  and  Interactive  Environments  for  Work¬ 
places  of  the  Future  (VIEW)"  a  modular  platform 
as  well  as  application  independent  test  battery 
for  VEs  of  all  sorts  was  developed. 

Method/Tools: 

Based  on  the  criteria  and  methodologies  ob¬ 
tained  from  pilot  studies,  questionnaires  and 
guided  interviews  with  developers  and  users  of 
VEs  of  all  sorts  (reaching  from  industrial  design 
over  manufacturing  to  health  related  applica¬ 
tions),  a  concise  test  battery  was  developed, 
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consisting  of: 

•  a  paper  and  pencil  -  based  module,  formed 
by  a  rapid  mixture  of  standardised  question¬ 
naires  and  self-rating  scales 

•  a  real-time  psychophysiological  module 

•  a  real-time  neurophysiological  module 
This  test  battery  was  designed  to  be  able  to  es¬ 
timate  mental  workload,  cognitive  performance, 
stress,  attention,  vigilance,  as  well  as  related 
constructs.  The  test  battery  is  modular,  so  that 
different  parts  of  it  can  be  used  for  different 
types  of  VE-applications,  depending  upon  com¬ 
plexity,  hours  of  continuous  use,  type  of  user 
and  environment,  cost,  etc. 

For  evaluation  purposes  the  test  battery  was 
used  during  a  variety  of  VE-based  pilot  applica¬ 
tions;  the  results  will  be  summed  up  in  the 
course  of  the  presentation. 

This  research  is  co-funded  by  the  European 
Commission,  grant  number:  IST-2000-26089, 
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Abstract: 

Social  support  has  been  shown  to  improve  the 
quality  of  life  of  HIV/AIDS  patients,  and  HIV/ 
AIDS  counseling  and  support  groups  have  tradi¬ 
tionally  been  used  as  a  means  of  providing  so¬ 
cial  support  to  patients.  Given  the  high  HIV  in¬ 
fection  rate,  South  Africa  faces  a  shortage  of 


counseling  resources.  This  study  investigated 
the  possibility  of  using  virtual  reality  technology 
to  provide  emotional  and  informational  support 
to  HIV/AIDS  patients.  Our  system  was  partly 
motivated  by  other  systems  that  have  been  suc¬ 
cessfully  used  to  provide  support  for  breast  can¬ 
cer  patients  (eg.  Breast  Cancer  Lighthouse  and 
Easing  Cancer  Park).  If  a  low  cost  VR  support 
system  were  effective,  it  could  greatly  increase 
the  number  of  HIV/AIDS  patients  receiving  sup¬ 
port. 

We  developed  a  low  cost,  deployable  desktop 
PC  based  system  using  custom  software.  The 
system  implements  a  VR  walkthrough  experi¬ 
ence  of  a  tranquil  campfire  in  a  forest.  The 
scene  contains  four  interactive  avatars  that  re¬ 
late  narratives  compiled  from  HIV/AIDS  pa¬ 
tients.  These  narratives  cover  the  aspects  of 
receiving  an  HIV+  diagnosis,  intervention,  and 
coping  with  living  with  HIV+  status.  To  evaluate 
the  system,  seven  computer  semi-literate  HIV+ 
volunteers  from  townships  around  Cape  Town 
used  the  system  under  the  supervision  of  a 
clinical  psychologist.  The  participants  were  in¬ 
terviewed  about  their  experiences  with  their  sys¬ 
tem,  and  the  data  was  analyzed  qualitatively. 

In  terms  of  emotional  impact,  the  participants 
found  their  experience  with  the  system  mostly 
encouraging,  particularly  the  narratives  relating 
to  adjustment  and  coping.  They  found  it  encour¬ 
aging  hearing  from  other  HIV+  individuals  rather 
than  from  other  sources.  The  participants  liked 
the  availability  of  the  computer  system,  and 
found  it  preferable  to  TV  or  pamphlets  as  a 
source  of  information,  due  to  its  interactivity  and 
the  control  it  affords  over  content  delivery.  The 
system  was  also  preferred  due  to  the  anonymity 
it  provides  to  those  not  willing  to  reveal  their  HIV 
status.  The  system  highlighted  the  potential 
benefits  of  joining  a  support  group,  and  moti¬ 
vated  some  participants  to  make  more  use  of 
support  groups.  In  general,  participants  found 
using  the  system  an  uplifting  experience,  rein¬ 
forcing  their  strength  in  coping  with  HIV.  As 
compared  to  other  forms  of  therapeutic  inter¬ 
vention,  participants  reported  that  they  received 
a  similar  cathartic  experience.  The  system  was 
considered  ideal  for  patients  who,  because  of 
their  fear  of  disclosing  their  HIV  status,  are  not 
receiving  support.  The  participants  generally 
preferred  real  support  groups  rather  than  the 
VR  system,  but  felt  that  the  system  could  aug- 
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ment  counseling  tools,  and  that  it  could  be  of 
benefit  in  places  where  counseling  resources 
were  not  available,  or  in  cases  where  joining  a 
support  group  was  difficult. 

Our  study  establishes  the  usefulness  of  low- 
cost  VR  systems  in  the  counseling  of  HIV/AIDS 
patients  in  developing  communities.  Such  sys¬ 
tems  cannot  replace  counseling,  but  can  play  a 
role  in  steering  people  towards  seeking  coun¬ 
seling,  as  well  as  providing  limited  support  in 
cases  where  counseling  resources  are  not 
available.  Our  findings,  although  preliminary, 
have  encouraged  the  further  development  of 
our  system  by  extending  the  degree  of  informa¬ 
tional  and  emotional  support  it  provides. 
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Research  status:  Still  in  progress 

Background: 

In  virtual  reality  (VR)  research  with  exposure 
treatment  for  phobias,  many  efficacy  studies 
have  been  realized.  Most  of  them  were  suc¬ 
cessful  in  showing  that  VR  exposure  is  at  least 
as  effective  as  in  vivo  exposure.  However,  few 
studies  have  been  done  on  treatment  mecha¬ 
nisms.  In  what  dimensions  is  VR  exposure  ef¬ 
fective?  Is  this  technique  suggestive  enough  to 
elicit  fear  when  the  participant  knows  the  stimuli 
are  not  real?  Is  exposure  affecting  cognitive 
processes  in  the  brain?  Many  subjective  meas¬ 
ures,  such  as  questionnaires,  are  available,  but 
they  remain  very  subjective.  This  is  where  ob¬ 
jective  outcome  measures  become  interesting. 

Method/Tools: 

In  this  study,  10  arachnophobics  went  through  a 
VR  treatment  program.  They  received  7  ses¬ 
sions  of  CBT  (60  mins  each).  During  the  first 
session,  participants  were  SCI D-diag nosed  with 
a  specific  phobia  (spiders),  according  to  the 
DSM-IV.  Subjects  suffering  from  major  comor- 
bid  disorders,  epilepsy,  major  heart  or  vestibular 
problems  were  excluded  from  the  study.  During 
the  second  session,  participants  received  infor¬ 
mation  about  phobias  and  CBT,  while  the  last 
five  sessions  were  devoted  to  gradual  exposure 
therapy  using  virtual  reality.  Virtual  worlds  were 
created  using  a  3D  computer  game  (Max 
Payne),  modified  to  offer  gradual  hierarchies  of 
fearful  stimuli  (spiders).  The  virtual  reality  expo¬ 
sure  was  conducted  with  a  Pentium  IV  com¬ 
puter,  an  1-Glass  head  mounted  display  and  an 
Intertrax2  motion  tracker. 

Participants  filled  out  questionnaires  assessing 
spider  phobia,  anxiety,  perceived  self-efficacy 
and  immersion  propensity  both  pre-  and  post¬ 
treatment.  They  also  went  through  a  Pictorial 
Stroop  task,  in  which  they  had  to  identify  the 
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color  of  a  filter  placed  over  pictures  with  various 
emotional  contents  (spiders/negative,  cows/ 
neutral  and  rabbits/positive).  Finally,  they  went 
through  a  behavioral  avoidance  test,  in  which 
they  had  to  press  a  button  to  make  a  platform 
move  forward.  On  this  platform  was  a  tarantula 
in  a  transparent  plastic  box,  lid  open.  During  this 
task,  participants’  heart  and  respiratory  rate 
were  recorded  using  CardioPro.  After  each  ex¬ 
posure  session,  participants  filled  out  question¬ 
naires  assessing  cybersickness  and  sense  of 
presence  in  the  virtual  environments. 

Conclusions: 

As  the  work  is  still  in  progress,  final  data  were 
not  available  at  the  time  this  abstract  was  writ¬ 
ten.  The  use  of  psychophysiological  measures 
to  better  understand  cognitive  mechanisms  un¬ 
derlying  the  effectiveness  of  VR  exposure  in  the 
treatment  of  phobias  is  relatively  rare,  even  in 
studies  with  in  vivo  exposure.  Many  debates  still 
persist  in  this  field  and  results  are  encouraging, 
but  sometimes  contradictive.  Hopefully,  this 
study  can  clarify  many  issues  and  stimulate  the 
inclusion  of  more  objective  and  reliable  meas¬ 
ures,  in  addition  to  subjective  measures,  in  the 
field  of  virtual  reality. 
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Research  Status: 

The  facial/mental  controlled  telerobotic  system 
research  was  completed  and  approved  by  the 
university  IRB.  Our  future  research  includes 
adding  an  extra  window  so  a  doctor  can  ob¬ 
serve  the  telerobotic  operator,  thus  making  the 
vocational/rehab  tool  a  telemedicine  diagnostic 
tool. 

Background/Problem : 

A  quadriplegic  man  wants  to  be  able  to  work  at 
a  local  pharmaceutical  company  as  a  technician 
to  mix  chemicals,  but  is  not  allowed  to  leave  his 
bed  due  to  unhealed  wounds.  A  telerobotic  sys¬ 
tem  is  needed  so  that  he  can  work  remotely. 
The  system  needs  to  be  operated  by  impulses 
at  the  forehead  because  the  man  has  no  use  of 
limbs.  The  quadriplegic  man  would  also  not 
mind  if  an  additional  window  was  added  so  his 
doctor  could  observe  him  and  show  he  is  in 
good  physical  and  mental  health  and  can  oper¬ 
ate  machinery.  This  tele-display  may  allow  the 
doctor  to  concentrate  on  his  other  patients  who 
live  in  remote  places  and  need  his  care.  Tele¬ 
health  is  realized  as  a  growing  need  in  the  21st 
century.  American  Richard  Grainger,  director 
general  of  the  UK  NHS  National  Programme  for 
IT  (NPfIT),  is  currently  spearheading  a  £2.3bn 
project  (Delivering  21st  Century  IT  Support  for 
the  NHS)  to  overhaul  National  Health  Service 
IT,  and  Telemedicine  or  Telehealth1  will  be  ex¬ 
pected  to  supply  many  patient-centric  benefits 
in  this  plan. 

Methods/Tools: 

A  visual  C++  program  was  created  to  operate 
with  a  robotic  arm,  interface  board,  and  a  web¬ 
cam.  This  system  was  also  connected  to  the 
Internet.  A  second  laptop  was  also  connected  to 
the  Internet  and  Microsoft  Netmeeting  was  in¬ 
stalled.  A  person  was  then  asked  to  use  a  Don 
Johnston  EMG  controller  or  Cyberlink  mental 
interface  to  select  scanned  buttons  representing 
robotic  arm  functions  at  the  other  remote  robotic 
arm  site  and  control  it  real  time  through  the 
Internet.  The  person  controlling  the  arm  was 
watching  the  movements  on  a  video  window  on 
the  desktop. 

Results: 

The  person  was  able  to  operate  the  robotic  arm 
in  a  real  time  environment  and  do  tasks.  The 
delay  between  the  robotic  arm  movements  and 
video  was  negligible  because  the  resolution  of 
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the  video  camera  was  kept  low  but  at  a  resolu¬ 
tion  that  was  clear  enough  to  allow  the  user  to 
do  a  task.  The  user  was  also  happy  to  be  able 
to  control  something  remotely. 

Novelty/Discussion: 

The  test  subject  asked  his  therapist  and  they 
know  of  no  other  telerobotic  systems  that  he 
can  operate.  Other  telerobotic  systems  were  of 
a  military  nature  [2]  or  for  the  chemical  industry 
[3].  There  was  one  experimental  telerobotic  arm 
system  at  Duke  University,  but  was  still  being 
used  in  experiments  involving  monkeys  [4],  A 
low  cost  telemedicine  telerobotic  system  is  a 
novel  approach  and  allows  vocational  rehabilita¬ 
tion  and  tele-medicine  diagnostic  application 
potentials  for  doctors  who  cannot  readily  visit 
patients  in  remote  places. 

Conclusion: 

It  may  be  possible  to  assess  attitude,  motor 
skills,  and  general  health  by  watching  the  user 
perform  a  task.  It  seems  that  the  system  may 
have  potential  as  a  telemedicine  diagnostic  tool 
in  addition  to  a  rehabilitative  vocational  tool. 
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Research  status:  Almost  complete 

Background: 

Videoconferencing  is  a  communication  medium 
that  allows  therapists  to  conduct  psychotherapy 
sessions  with  clients  that  are  far  away  (e.g.  rural 
areas).  Ongoing  research  in  our  lab  suggests 
that  the  development  of  a  therapeutic  alliance  is 
possible  but  related  to  the  illusion  of  presence. 
However,  there  is  no  empirical  data  to  docu¬ 
ment  the  relationship  between  presence  and  the 
emotional  engagement  and  how  it  takes  place. 

The  objective  of  this  study  is  to  determine  if  the 
extent  to  which  an  individual  is  engaged  in  an 
emotionally  charged  discussion  affects  pres¬ 
ence. 

Method/Tools: 

The  sample  consists  of  40  participants  between 
20  and  56  years  of  age  assigned  randomly  to 
two  conditions:  (a)  High  Emotion  First  (High-EF; 
describing  a  highly  emotional  event  first,  fol¬ 
lowed  by  the  description  of  a  less  emotionally 
involving  event),  or  (b)  Low  Emotion  First  (Low- 
EF;  same  as  the  other  condition  but  in  the  oppo¬ 
site  order).  For  the  study,  two  Vision  5000  sys¬ 
tems  from  Tandberg  are  used,  connected  by 
TCP/IP  at  a  rate  of  384  kbits/s. 

The  procedure  was  to  first  identify  and  rank  five 
positive  events  that  the  individual  has  experi¬ 
enced  and  then  select  the  most  and  the  least 
emotionally  involving  ones.  The  Immersive  Ten¬ 
dency  Questionnaire  and  the  Attitude  Toward 
Telecommunications  Questionnaire  were  then 
completed,  followed  by  a  15-minute  discussion 
in  videoconference  about  the  first  emotionally 
involving  event.  The  Presence  Questionnaire  in 
Videoconference  was  then  completed,  followed 
by  a  distraction  task.  Finally,  participants  dis¬ 
cussed  the  second  emotionally  involving  event 
for  15  minutes  in  videoconference  and  com¬ 
pleted  the  presence  questionnaire  again. 

Results  and  Conclusions: 

The  results  show  that  the  sense  of  presence 
isn't  highly  affected  by  the  emotional  content  of 
the  discussion.  However,  the  individuals  who 
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felt  more  comfortable  communicating  via  video¬ 
conferencing  experienced  a  stronger  sense  of 
presence.  Increasing  the  sample  size  would 
allow  more  power  to  find  a  significant  Time  x 
Condition  interaction  between  the  High-EF  and 
the  Low-EF  conditions. 
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Software  design  and  description;  Planned  study 
Background: 

Feedback  from  tactile  and  kinesthetic  receptors 
contributes  to  the  haptic  sense,  enabling  us  to 
manipulate  objects  with  precision  and  smooth¬ 
ness.  Cumulative  evidence,  from  both  neurosci¬ 
ences  and  clinical  research  indicates  the  impor¬ 
tant  role  that  haptic  feedback  may  play  in  reha¬ 
bilitation  intervention.  Neurophysiological  stud¬ 
ies  suggest  that  specific  haptic  stimuli  may  fa¬ 
cilitate  plasticity  processes  required  to  recover 
damaged  sensory  and  motor  maps  in  the  brain 

[1] .  Moreover,  haptic  stimuli  have  been  shown 
to  be  involved  in  Cross  Modal  Transfer,  where 
knowledge  acquired  in  one  modality  improves 
performance  when  employing  another  modality 

[2] .  The  benefits  of  using  haptic  feedback  as 
part  of  therapy  for  patients  with  stroke  have  also 
been  demonstrated  [3].  The  inclusion  of  haptic 
information  within  virtual  environments  may  en¬ 
hance  performance,  relevance,  reality,  meaning 
and  presence. 

Problem: 

The  roles  of  haptic  feedback  in  virtual  environ¬ 
ments  and  its  potential  benefits  for  cybertherapy 
have  not  been  systematically  characterized. 


Thus,  it  is  not  clear  which  types  of  impairments 
(motor,  cognitive,  sensory)  will  be  most  helped 
by  the  addition  of  haptic  feedback.  To  a  large 
extent,  this  void  is  due  to  the  high  cost  and  en¬ 
cumbrance  of  many  of  the  currently  available 
haptic  devices.  The  objective  of  this  study  was 
to  develop  a  "low-end"  multimodal  (visual,  audi¬ 
tory,  haptic)  feedback  program  that  would  en¬ 
able  clinicians  to  easily  design  a  diverse  assort¬ 
ment  of  virtual  environments  for  the  delivery  of 
tasks  suited  for  the  rehabilitation  of  motor,  cog¬ 
nitive  or  sensory  deficits. 

Method/Tools: 

We  have  created  software  that  runs  on  a  stan¬ 
dard  PC  desktop  and  uses  an  off-the-shelf  hap¬ 
tic  joystick  interface  (Microsoft's  Sidewinder 
Force  Feedback  2).  This  user-friendly  program 
enables  a  therapist  or  researcher  to  quickly  de¬ 
sign  audio-visual-haptic  environments.  The  pro¬ 
gram  has  two  components,  an  Editor  and  a 
Simulator.  The  therapist  uses  the  Editor  to  place 
objects  of  different  sizes  and  shapes  on  the 
screen.  These  objects  are  assigned  various  at¬ 
tributes  such  as  color,  sound,  movement,  and 
type  and  intensity  of  haptic  feedback.  Juxtapo¬ 
sition  of  the  virtual  objects  and  association  of 
their  attributes  enables  the  creation  of  simple  as 
well  as  complex  environments  (e.g.,  dynamic 
mazes).  The  Simulator  is  then  employed  for 
running  experimental  trials  or  for  conducting 
intervention.  Although  simple  to  operate,  many 
sophisticated  game-like  tasks  may  be  designed 
and  used  for  a  gamut  of  research/treatment 
goals  that  test  and  train  participant  abilities  in¬ 
cluding: 

•  cognitive  deficits  (e.g.,  executive  function¬ 
ing,  spatial  orientation,  memory) 

•  motor  deficits  (e.g.,  motor  planning,  motor 
control) 

•  sensory  deficits  (e.g.,  orientation  and  navi¬ 
gation  skills  for  people  who  are  visually  im¬ 
paired,  proprioceptive  deficits  for  patients 
following  stroke,  reeducation  for  peripheral 
nerve  injuries) 

•  functional  skills  (e.g.,  simulator  training  to 
learn  to  operate  a  powered  wheelchair) 

The  software  will  be  first  tested  with  a  group  of 
healthy  subjects  and  with  patients  who  have 
had  a  stroke  and  whose  deficit  is  primarily  sen¬ 
sory.  Their  ability  to  perform  mazes  of  varying 
difficulty  under  visual-auditory,  visual-haptic, 
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and  visual-auditory-haptic  conditions  will  be 
compared  to  determine  the  contribution  of  hap¬ 
tic  feedback  to  task  performance. 

Novelty: 

This  software  makes  the  use  of  haptic  feedback 
widely  accessible  to  the  cybertherapy  commu¬ 
nity.  It  offers  a  wide  array  of  therapeutic  tools 
which  are  easy  to  design  and  execute.  In  addi¬ 
tion  to  its  immediate  clinical  applications,  we 
anticipate  that  this  tool  will  allow  for  future  stud¬ 
ies  of  cross  modal  tasks,  eventually  leading  to 
the  development  of  additional,  haptic-based 
therapeutic  interventions. 
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Background: 

The  work  aims  at  the  definition  of  a  model  about 
how  trust  is  built  in  on-line  interactions  to  be 
applied  in  different  situations:  on-line  therapy, 
on-line  psychological  counseling  and  trust 
based  on-line  interaction. 

Method: 

One  of  the  main  problems  of  on-line  interactions 
consists  of  winning  the  users’  resistance  in  or¬ 
der  to  gain  trust.  As  trust  is  not  only  based  on 
previous  experiences  but  also  on  feelings  and 
impressions  emerging  during  the  interaction,  the 
study  aims  at  finding  out  which  elements  make 
a  website  trust-worthy. 

In  order  to  obtain  basic  information  about  web 
interaction  processes,  the  project  has  been  di¬ 
vided  into  two  different  phases: 

•  first  phase:  on-line  interactions  in  laboratory 
context 

•  second  phase:  on-line  interactions 
‘observed’  in  real  context  adopting  an 
ethno-methodological  approach 

We  applied  both  traditional  and  new  usability 
methods  suitable  for  the  test  performed: 

•  voice  recording  of  users’  comments  during 
the  interaction  (thinking  aloud) 

•  interviews  (post  cognitive  walkthrough) 

•  questionnaire 

•  personal  journal 

•  simulation  game  (e-commerce  website  pro¬ 
ject) 

•  on-line  questionnaire 
Novelty: 

On  the  basis  of  the  collected  data,  a  model  was 
prepared  to  represent  web-based  trust  building 
and  maintenance  processes.  In  this  model,  in¬ 
terface  elements  are  the  starting  point  to  per¬ 
ceive  information  on  the  web-site  structure,  on 
the  catalogue  structure  and  to  get  information 
on  items  included.  Information  collected  allows 
the  user  to  create  a  mental  model  of  the  whole 
interaction  process,  instead  of  just  the  web  site. 
This  model  is  based  upon  “structure”  and 
“contents”. 

The  mental  model  is  interpreted  and  applied  in 
order  to  find  out  information  on  the  products,  on 
the  ’other’  speaking  through  the  web  site,  on 
any  other  interlocutor  and  on  the  interaction  it¬ 
self.  This  information  is  then  evaluated,  accord- 
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ing  to  different  criteria: 

•  Interest 

•  Satisfaction  about  the  interaction 

•  Perceived  competence 

•  Perceived  transparency 

The  "Interest”  criterion  is  applied  in  order  to  de¬ 
cide  to  carry  on  the  interaction  or  not:  it  is  based 
on  motivation,  which  consists  in  the  cost. 
“Satisfaction  about  the  interaction”  underlines 
the  importance  of  usability  and  accessibility  of 
the  site.  “Perceived  competence”  is  an  element 
pertaining  to  the  users’  mental  model  of  the 
seller  as  well  as  the  “Perceived  transparency”. 

During  this  process,  users  continue  with  the 
interaction  task  only  when  the  mental  model  is 
clear  enough  and  the  different  criteria  are  ful¬ 
filled.  Interaction  tasks  are  not  to  be  considered 
independent  and  separated,  but  complemen¬ 
tary.  In  order  to  reach  the  goal,  confidence  and 
trust  must  be  generated. 

The  most  important  innovation  of  this  research 
is  the  focus  on  the  whole  interaction,  on  its 
tasks  and  the  creation  of  a  mental  model,  rather 
than  only  on  the  result  of  the  interaction  process 
(trust  or  distrust). 

The  second  phase  of  the  research  is  to  obtain 
qualitative  and  quantitative  data  in  order  to  vali¬ 
date  the  model  and  to  generalize  it  to  various 
contexts:  telemedicine,  on-line  psychological 
counseling  and  therapy. 
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Phobias  are  one  of  the  most  common  mental 
disorders.  It  is  estimated  that  about  11%  of  the 
US  population  suffers  from  a  specific  phobia, 
and  around  6%  suffer  from  agoraphobia  accord¬ 
ing  to  epidemiological  studies  (National  Comor¬ 
bidity  Survey;  Magee,  Eaton,  Wittchen,  McGo- 
nagle  &  Kessler,  1996).  Exposure  therapy  is  a 
well-established  treatment  for  phobias.  There 
are  different  modalities  of  exposure  therapy. 
The  most  successful  and  commonly  used  is  “in 
vivo”  exposure.  This  technique  offers  high  suc¬ 
cess  rates  (75-95%  of  patients  clinically  im¬ 
proved)  and  long-term  effectiveness  (one-year 
follow-up).  Because  of  this,  “in  vivo”  exposure  is 
considered  to  be  the  treatment  of  choice  for 
specific  phobia.  However,  despite  the  fact  that 
phobias  can  be  successfully  treated,  very  few 
phobics  ever  seek  treatment.  It  is  estimated  that 
only  15%  seek  treatment  (Boyd  et  al.,  1990). 
Aside  from  the  low  percentage  that  seek  treat¬ 
ment,  around  25%  either  refuse  the  “in  vivo” 
procedure  or  drop  out  (Marks,  1992).  The  main 
reason  patients  refuse  “in  vivo”  exposure  is  that 
they  are  too  afraid  to  confront  the  feared  object 
or  situation.  Because  of  this,  we  think  that  al¬ 
though  “in  vivo”  exposure  is  an  effective  treat¬ 
ment,  new  efforts  are  needed  to  increase  the 
number  of  phobia  sufferers  who  seek  and  suc¬ 
cessfully  complete  the  treatment. 

Making  the  treatment  less  intimidating  would  be 
a  good  start.  We  think  that  VR  can  help  to 
achieve  this  goal.  VR  exposure  has  some  ad¬ 
vantages  over  “in  vivo”  exposure  that  may  make 
it  less  aversive  and  more  attractive  to  phobia 
sufferers.  The  main  advantage  is  the  high  level 
of  control  over  the  feared  object.  In  VR,  the 
feared  situation  can  be  more  easily  and  more 
accurately  graded.  VR  also  allows  for  easier 
repetition  of  the  exposure  tasks.  Finally,  it  is 
possible  to  carry  out  exposure  without  leaving 
the  consultation  room,  assuring  more  confidenti¬ 
ality.  We  think  that  patients  who  are  reluctant  to 
start  an  “in  vivo”  program  may  be  more  willing  to 
get  involved  in  a  VR  treatment.  In  a  former 
study,  we  surveyed  a  sub-clinical  phobic  sam¬ 
ple.  The  results  showed  a  higher  degree  of  ac¬ 
ceptance  of  VR  exposure  vs.  “in  vivo”  exposure 
(Garcia-Palacios,  Hoffman,  Kwong  See,  Tsai, 
A.  &  Botella,  2001).  The  present  study  surveyed 
102  patients  who  met  DSM-IV  criteria  for  spe- 
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cific  phobias  (animal  type,  situational)  or  panic 
disorder  with  agoraphobia  (a  clinical  sample). 
When  asked  to  choose  between  “in  vivo”  expo¬ 
sure  vs.  VR  exposure  therapy,  70%  chose  VR 
exposure.  23.5%  refused  in  vivo  exposure 
whereas  only  3%  refused  VR  treatment.  This  is 
the  first  survey  that  offers  data  of  acceptance 
and  refusal  rates  of  in  vivo  exposure  vs.  VR  ex¬ 
posure  in  a  sample  of  clinically  phobic  individu¬ 
als.  Our  findings  suggest  that  VR  exposure  ther¬ 
apy  may  prove  valuable  for  increasing  the  num¬ 
ber  of  phobics  who  seek  treatment  and  for  de¬ 
creasing  the  “in  vivo"  exposure  refusal  rates.  VR 
exposure  can  help  to  improve  the  efficacy 
achieved  by  one  of  the  most  important  tech¬ 
niques  in  the  treatment  of  anxiety  disorders, 
exposure  therapy. 
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Background/Problem : 

Attention  plays  an  important  role  in  perception 
of  painful  stimuli,  and  several  studies  have  iden¬ 
tified  the  efficacy  of  distraction  for  reducing  pain 
among  children  who  must  undergo  invasive 
medical  procedures.  Numerous  methods  of  dis¬ 
traction  have  been  evaluated  and  recently,  vir¬ 
tual  reality  (VR)  was  identified  as  a  potentially 
effective  tool  for  pain  distraction.  Due  to  its 
highly  involving  nature,  VR  may  mediate  painful 
stimuli  by  engaging  the  user  and  placing  signifi¬ 
cant  demands  on  the  limited  cognitive  resource 
of  attention.  VR  has  shown  promise  as  a  non- 
pharmacological  pain  management  tool  with 
several  populations  and  medical  procedures. 
One  frequently  required  painful  procedure  is 
venipuncture.  This  procedure  involves  piercing 
a  vein  with  a  needle  for  the  purpose  of  a  blood 
draw.  Despite  its  relatively  routine  nature, 
venipuncture  has  been  reported  to  be  among 
the  most  feared  hospital  experiences  for  child 
patients. 

Method/Tools: 

This  study  presents  preliminary  data  on  the  ef¬ 
fectiveness  of  VR  as  a  child  pain  distracter  dur¬ 
ing  a  blood  draw.  Children  (8-12  y/o)  arriving  at 
the  phlebotomy  laboratory  at  Children’s  Hospital 
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of  Los  Angeles  for  the  purpose  of  a  blood  draw 
were  recruited.  Participants  completed  baseline 
measures  and  were  then  randomly  assigned, 
stratified  for  age  and  gender,  to  have  their  blood 
drawn  in  one  of  four  conditions:  a  control  condi¬ 
tion  (without  distraction),  cartoon  distraction, 
distraction  by  a  VR  scenario  presented  on  a  flat- 
screen  computer,  and  the  same  VR  scenario 
presented  in  a  head  mounted  display  system. 
Visual  perception  of  the  needle  was  controlled 
across  all  conditions  by  a  visual  occlusion.  Child 
self-reports  of  needle  pain,  parent  and  phleboto- 
mist  reports  of  child  pain,  and  parent  and  child 
state  anxiety  were  measured.  In  addition,  chil¬ 
dren  completed  a  measure  of  presence  and 
simulator  sickness  symptoms. 

Results: 

Preliminary  results  on  57  participants  found  that 
children  distracted  by  VR  reported  significantly 
less  affective  pain  than  children  in  the  cartoon 
or  flat-screen  VR  distraction  groups.  Significant 
differences  between  conditions  were  not  found 
for  child  or  parent  anxiety;  nor  were  they  found 
for  parent  or  phlebotomist  ratings  of  child  pain. 
A  significant  negative  correlation  was  found  be¬ 
tween  child  rating  of  presence  and  self-reported 
pain,  supporting  the  theoretical  connection  be¬ 
tween  degree  of  involvement  and  mediation  of 
pain.  No  child  reported  significant  levels  of 
simulator-related  side  effects. 

Conclusion: 

Although  these  are  preliminary  findings  on  half 
of  the  full  data  set,  this  study  is  consistent  with 
previous  studies  exploring  the  potential  of  VR 
for  non-pharmacological  pain  management.  The 
current  study  extends  previous  findings  to  8-1 2 
year-olds  undergoing  venipuncture  and  sup¬ 
ports  the  pain  management  potential  of  this 
evolving  technology.  As  technological  advances 
in  VR  continue  with  resultant  enhancements  of 
the  experience  of  presence,  virtual  reality  may 
turn  pain  into  a  virtual  unreality. 

Novelty/Discussion: 

The  current  research  is  novel  in  that  it  uses  a 
between  groups  design  to  test  the  effects  of  VR 
across  display  conditions  (HMD  vs.  Flatscreen), 
compared  to  passive  watching  of  a  cartoon  and 
standard  care  in  children.  However,  we  have 
also  added  to  standard  care,  a  physical  barrier 
so  that  the  pain  site  is  occluded  from  the  child’s 
vision.  This  more  conservative  test  controls  for 


visual  occlusion  across  all  conditions  (the  bar¬ 
rier  was  used  in  all  groups)  and  will  tell  us  if  the 
actual  attentional  component  of  VR  has  pain 
distracting  effects  BEYOND  what  we  might  ob¬ 
serve  by  simply  having  the  subject  wear  a  blind¬ 
fold!  Basically,  we  know  VR  works  in  this 
application  area,  but  we  need  to  begin  isolating 
the  components  that  are  active  ingredients,  so 
that  we  can  design  cost  effective  systems  with 
the  highest  level  of  positive  impact. 
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Background: 

Standard  Exposure  (SE)  is  considered  the  stan¬ 
dard  of  care  in  treating  specific  phobias.  How¬ 
ever,  SE  can  be  difficult  to  arrange  for  fear  of 
flying,  especially  after  the  events  of  9-11-01. 
Difficulty  gaining  access  to  airport  facilities  and 
equipment  to  conduct  SE,  difficulties  associated 
with  conducting  treatment  in  public  locations 
and  the  costs  of  accompanying  persons  on 
flights  can  make  SE  untenable.  Virtual  Reality 
Exposure  (VRE)  offers  significant  advantages  in 
the  treatment  and  research  of  anxiety  and  other 
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disorders.  Virtual  Reality  (VR)  allows  users  to 
interact  in  various  ways  within  a  computer¬ 
generated  virtual  world.  Use  of  Head  Mounted 
Displays  (HMD’s),  motion  trackers,  and  vibra¬ 
tion  platforms  allow  one  to  experience  the  vir¬ 
tual  world  as  one  would  experience  the  real 
world,  resulting  in  a  sense  of  presence  or  im¬ 
mersion  in  the  virtual  world.  VRE's  have  been 
utilized  in  the  clinical  treatment  of  anxiety  disor¬ 
ders  since  approximately  1 992  (for  a  review  see 
Anderson,  et  al,  2001,  Bulletin  of  the  Menninger 
Clinic,  65,  78-91). 

Method: 

Seventy-five  participants  who  met  DSM-IV  crite¬ 
ria  for  specific  phobia  (fear  of  flying)  completed 
treatment  after  being  randomly  assigned  to 
VRE,  SE,  or  WL.  WL  participants  were  also  ran¬ 
domly  assigned  to  either  VRE  or  SE  treatment 
after  serving  as  controls.  Random  assignment, 
use  of  a  standardized  treatment  manual,  ho¬ 
mogenous  inclusion  criteria,  and  blind  inde¬ 
pendent  assessment  are  features  of  this  meth¬ 
odologically  rigorous  study. 

Treatments  were  delivered  in  8  individual  ses¬ 
sions  across  six  weeks.  VRE  and  SE  groups 
received  identical  treatment  for  sessions  1-4, 
including  assessment  and  anxiety  management 
skills  training.  During  sessions  5-8,  participants 
engaged  in  exposure  therapy,  either  at  the  air¬ 
port  (SE)  or  in  the  therapist’s  office  using  the 
virtual  airplane  (VRE).  After  completion  of  treat¬ 
ment,  participants  were  offered  the  opportunity 
to  take  a  graduation  flight.  During  the  flight, 
anxiety  measures  were  collected. 

Results: 

Results  indicated  that  VRE  and  SE  did  not  differ 
on  standardized  questionnaires,  willingness  to 
fly,  anxiety  ratings  during  flight,  self-ratings  of 
improvement,  nor  patient  satisfaction  with  treat¬ 
ment.  Both  active  treatments  were  significantly 
better  than  WL,  which  showed  no  difference 
from  pre-  to  post-treatment. 

Six  and  twelve  month  follow  up  data  indicated 
that  participants  maintained  gains  made  during 
treatment.  Both  groups  had  similar  numbers  of 
respondents  and  repeated  measures  ANOVA 
analyses  did  not  reveal  differences  between  the 
treatment  groups  during  follow  up. 


Conclusions: 

The  findings  support  the  use  of  virtual  reality 
exposure  for  treatment  of  fear  of  flying.  Expo¬ 
sure  in  vivo  did  not  differ  from  exposure  in  VR 
immediately  post  treatment,  6  months,  or  12 
months  post  treatment  on  any  outcome  meas¬ 
ure,  including  standardized  questionnaires  or  a 
behavioral  avoidance  test  (graduation  flight). 
VRE  offers  significant  advantages  in  terms  of 
treatment  logistics  and  efficiency  without  sacri¬ 
ficing  the  efficacy  of  SE.  Importantly,  VR  allows 
treatment  to  be  conducted  in  the  privacy  and 
convenience  of  an  office  setting,  more  control 
over  stimuli,  easy  repetition  of  feared  scenes, 
and  the  opportunity  to  standardize  exposure  to 
a  variety  of  cues  across  locations. 

Novelty: 

This  study  is  the  largest,  controlled  study  of 
VRE  for  fear  of  flying  to  date.  (497) 
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Avatar  Diplomacy 

Research  is  in  progress  to  use  VR  for  relieving 
psychological  damage  suffered  by  children 
growing  up  in  war  zones.  The  “pen  pals”  move¬ 
ment  fostered  a  feeling  of  international  connec¬ 
tion  and  friendship  in  school-age  children,  which 
mitigated  the  feeling  of  fearful  isolation  induced 
by  World  War  II.  While  the  pen  pals  movement 
helped  previous  generations  connect  by  using 
pen-and-paper  letters  exchanged  through  con- 
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ventional  postal  services,  today's  youth  are  en¬ 
gaged  in  video  games  and  avatars  on  the  Inter¬ 
net.  "Avatar  Diplomacy"  is  the  guided  use  of 
networked  virtual  environments  to  connect 
school-age  children  through  culturally  custom¬ 
ized  avatars  in  specially  designed  virtual  worlds. 
The  first  phase  of  this  project  began  with  re¬ 
search  on  the  aesthetics  of  Internet  virtual 
worlds  conducted  from  1997-2001  at  Art  Center 
College  of  Design  in  Pasadena,  California.  Re¬ 
sults  from  this  study  were  presented  in  several 
places  including  VRST  2000  (Seoul,  Korea), 
Computer  Graphics  World  (January  2001),  SIG- 
GRAPH  2000,  and  at  UNESCO  in  Rio  de 
Janiero  (May  2003). 

What  emerged  from  the  first  phase  of  research 
was  a  model  of  avatar  encounters  that  is  not 
restricted  to  role-playing  games  (e.g.  Ever- 
Quest),  nor  based  on  rule-based  behavior  like 
most  computer  video  games.  The  model  is  not 
one  of  competition  but  one  of  encountering  alien 
avatars  and  exploring  their  features.  The  model 
relies  on  the  use  of  a  series  of  meetings  that  are 
highly  focused  events  (each  one-hour  long) 
guided  by  skilled  moderators  who  host  the  ava¬ 
tar  encounters. 

The  next  phase  of  the  project  addresses  the 
deployment  of  a  handful  of  geographically  dis¬ 
persed  nodes  on  different  continents  where 
moderated  avatar  encounters  can  be  launched 
from  participating  schools.  The  results  from  this 
phase  will  determine  the  shape  of  the  final  pro¬ 
ject  to  be  implemented  in  international  conflict 
zones.  This  intermediate  phase  seeks  to  estab¬ 
lish  the  role  of  visualization  techniques  in  cus¬ 
tomizing  avatars.  At  Beach  Cities  Health  and 
Healing  Center  (www.bchd.org),  the  classes 
both  in  Meditation  and  in  Tai  Chi  use  a  se¬ 
quence  of  body-based  visualizations  to  effect 
the  shifts  in  perception,  breathing,  and  a  sense 
of  well  being.  While  these  classes  draw  on 
Patricia  Carrington’s  research  into  Clinically 
Standardized  Meditation  (CSM),  the  visualiza¬ 
tion  techniques  used  at  BCHD  are  Taoist  pro¬ 
jections  of  the  imagined  physical  body.  Such 
image  projections  share  many  characteristics 
with  avatar  self-projection  in  virtual  worlds. 

The  upcoming  phase  of  research  seeks  to  de¬ 
termine  which  imaginative  projections  work 
most  effectively  for  the  implementation  of  avatar 
diplomacy.  This  phase  tests  the  responses  of 


the  first  nodes  of  users  to  determine  the  most 
appropriate  avatar  designs  and  activities  that 
will  underpin  the  later  implementation  of  avatar 
diplomacy.  Tools  in  this  phase  will  be  widely 
available  3D  software  such  as  ActiveWorlds 
Universe  and  Adobe  Atmosphere  3D.  As  in  pre¬ 
vious  experiments,  users  will  receive  instruction 
on  how  to  design  their  own  avatars  using  Avatar 
Lab,  a  subset  of  Poser  software 
(www.curiouislabs.com). 

[Note:  Many  of  these  references  are  available 
on  the  Web.  See  links  at  www.mheim.com  un¬ 
der  “Articles”  and  “Books”.] 
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Virtual  Reality  Therapy:  A  Systematic  Review  of 

the  Effectiveness  of 
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Research  Status:  In  progress 

Background: 

For  the  past  decade  the  number  of  new  studies 
being  published  on  the  proposed  applications  of 
Virtual  Reality  Therapy  (VRT)  for  rehabilitation 
has  increased  exponentially.  The  literature  sup¬ 
ports  the  benefits  of  VRT  in  the  improvement  of 
a  wide  range  of  physical,  mental,  or  behavioral 
disorders. 

Problem: 

Although  there  is  evidence  to  support  the  posi¬ 
tive  benefits  of  VRT,  there  are  no  studies  that 
systematically  review  the  level  of  evidence  of 
VRT  interventions.  The  widespread  application 
of  such  interventions  should  be  preceded  by 
evidence  of  directly  attributable  improvements 
on  the  desirable  physical,  mental,  or  behavioral 
outcome. 

Aim: 

The  purpose  of  this  study  is  to  quantitatively 
review  the  published  literature  to  determine 
whether  VRT  is  a  beneficial  therapeutic  tool  to 
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improve  physical,  mental,  or  behavioral  disor¬ 
ders. 

Methods  &  Data  Sources: 

A  database  from  1980  to  July  2003  of  published 
and  non-published  manuscripts  will  be  compiled 
by  using  MEDLINE,  PUBMED,  CINAHL,  Psy- 
clnfo,  Psyc-Lit,  Educational  Resources  Informa¬ 
tion  Center  (ERIC),  Rehabdata,  PEDro,  NIDRR, 
the  Cochrane  Controlled  Trials  Register,  Disser¬ 
tation  Abstracts,  and  the  reference  list  of  identi¬ 
fied  studies  and  other  reviews  will  be  examined. 
Key  words  that  will  be  used  in  the  search  are 
virtual  reality,  virtual  environment,  and  com¬ 
puter-assisted  combined  with  therapy  or  reha¬ 
bilitation,  or  intervention.  Additional  key  word 
combinations  include  cognitive,  mental,  physi¬ 
cal,  activity,  exercise,  fitness,  movement,  occu¬ 
pational,  disorders,  neurological,  psychiatric, 
pediatric,  behavior,  psychological,  impairment, 
function,  and  disability.  Articles  not  written  in 
English  will  be  excluded. 

Study  Selection: 

To  be  selected  for  detailed  review,  reports  have 
to  meet  the  following  criteria:  (1)  evaluate  the 
effects  of  a  VRT  intervention  (rehabilitation  or 
therapeutic  program)  on  physical,  mental,  or 
behavioral  outcomes,  (2)  describe  the  clinical 
population,  (3)  describe  the  outcome  measures, 
and  (4)  report  enough  data  for  meta-analysis. 

Data  Extraction: 

Studies  that  meet  the  inclusion  criteria  will  be 
analyzed  for  methodological  quality  and  for  rele¬ 
vant  effect  size  calculation. 

Data  Synthesis: 

For  each  selected  outcome,  summary  effects 
will  be  computed  by  pooling  standardized  mean 
differences  as  well  as  raw  mean  differences. 
Frequencies  and  descriptive  statistics  will  be 
reported. 

Results: 

Results  will  be  reported  on  effect  size  index  and 
confidence  intervals.  In  addition,  descriptive 
information  about  moderator  variables;  the  type 
of  VR  therapy,  duration  and  level  of  exposure, 
clinical  population,  and  mode  of  VRT  will  be 
presented. 

Key  Words: 

Virtual  reality,  virtual  environment,  therapy,  re¬ 


habilitation,  mental,  psychological,  physical, 
psychiatric,  behavioral,  cognition,  functioning. 
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Advances  in  Using  Simulations  to  Train  Com¬ 
plex  Decision-Making  in  Teams 

Advances  in  cognitive  science  research  have 
provided  great  insight  into  how  people  learn  and 
recommendations  for  improving  learning  out¬ 
comes.  As  a  result,  there  has  been  a  prolifera¬ 
tion  of  instructional  design  theories  and  models 
for  education  and  training.  While  there  are  nu¬ 
merous  theories  and  models  -  many  of  which 
use  different  terms  -  there  are  fundamental  un¬ 
derlying  principals  which  many  have  in  com¬ 
mon.  For  example,  cognitive  science  has  long 
recognized  that  learning  environments  that  pro¬ 
vide  opportunities  for  learners  to  apply  their 
knowledge  to  solve  practical  problems  can  lead 
to  faster  learning,  greater  retention,  and  higher 
levels  of  motivation  and  interest.  Simulations 
that  allow  learners  to  visualize  complex  phe¬ 
nomenon  and/or  provide  opportunities  for  prac¬ 
tice  and  experimentation  have  proven  very  ef¬ 
fective.  Simulations  offer  a  number  of  advan¬ 
tages  compared  to  training  with  actual  equip¬ 
ment  or  in  the  actual  job  environment.  They 
can  be  used  as  practice  environments  for  tasks 
that  are  too  dangerous  to  be  practiced  in  the 
real  world.  Simulations  can  provide  increased 
opportunities  for  practice  on  tasks  that  occur 
infrequently  (e.g.,  emergency  procedures)  and 
they  can  be  used  when  actual  equipment  can¬ 
not  be  employed.  Simulations  can  contain  em¬ 
bedded  instructional  features  (e.g.,  feedback) 
that  enhance  the  instructional  experience. 
Simulations  can  also  represent  significant  cost 
savings  compared  with  training  on  operational 
equipment.  Modern  technology  is  providing 
increased  opportunities  to  deploy  simulations 
that  allow  team  members  who  are  physically 
dispersed  to  train  together  over  a  network.  Un¬ 
fortunately,  apart  from  military  applications  and 
a  few  selected  industries  (e.g.,  pilot  training), 
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simulation-based  training  is  rarely  used  today 
because  it  is  difficult  to  implement  in  standard 
instructional  environments.  Expected  improve¬ 
ments  in  technology,  however,  have  the  poten¬ 
tial  to  significantly  reduce  the  cost  and  complex¬ 
ity  of  implementing  learning-by-doing  environ¬ 
ments.  The  combined  forces  of  high-powered 
computing,  unparalleled  bandwidth,  and  ad¬ 
vances  in  software  architecture  are  poised  to 
make  realistic  gaming  and  simulation  environ¬ 
ments  more  feasible  and  economical.  Because 
these  tools  will  be  increasingly  available,  it  is 
important  to  understand  appropriate  contexts 
and  methods  for  implementation. 

This  session  will  explore  the  use  of  modeling 
and  simulation  to  enhance  team  decision  mak¬ 
ing  and  performance  based  on  theoretically 
driven,  empirically  based  guidelines.  Teams 
are  used  with  growing  frequency  by  modern 
organizations,  ranging  from  business  decision¬ 
making  to  national  security  matters.  The  com¬ 
plexity  and  scope  of  issues  to  be  addressed 
often  require  the  efforts  of  multiple  people  work¬ 
ing  together.  Thus,  the  performance  of  teams 
and  their  decision-making  abilities  have  a  great 
impact  on  the  success  of  organizations.  The 
panel  will  summarize  recent  research  progress 
toward  understanding  decision-making  in 
teams,  including  research  on  competencies, 
tools  and  instructional  strategies  that  contribute 
to  team  performance.  Technologies  used  to 
validate  the  fact  that  realistic  simulations  pro¬ 
vide  a  highly  effective  way  to  train  complex  de¬ 
cision  making  skills  will  be  examined.  The 
panel  will  conclude  with  a  discussion  of  issues 
and  trends  related  to  simulation,  including  how 
to  make  them  easier  to  build  and  incorporate 
into  learning  environments,  as  well  as  describe 
some  the  current  uses  of  simulation  in  team 
training. 
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A  functional  Magnetic  Resonance  Imaging 
(fMRI)  Study  of  Nicotine  Craving  and  Cue  Expo¬ 
sure  Therapy  (CET)  by  using  Visual  Stimuli 
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Research  Status:  In  Process 

Objective: 

Cue  Exposure  Therapy  (CET)  refers  to  the 
manual,  repeated  exposure  to  smoking-related 
cues  aimed  at  reducing  cue  reactivity  by  extinc¬ 
tion.  Traditionally,  pictures  or  real  objects  have 
been  used  for  CET.  In  our  previous  research, 
comparing  the  changes  of  craving  before  and 
after  exposure  to  Virtual  Environment  (VE)  and 
still  photos,  the  increase  of  craving  with  VE  ver¬ 
sus  pictures  was  shown  to  be  significantly  larger 
[1].  However,  this  previous  study  used  subjec¬ 
tive  questionnaires  to  measure  the  changes.  In 
this  study,  we  are  planning  to  find  objective  evi¬ 
dence  of  VE’s  effectiveness  in  CET  using  func¬ 
tional  Magnetic  Resonance  Imaging  (fMRI).  For 
this,  we  constructed  a  VE  for  drawing  one’s  de¬ 
sire  of  nicotine  based  on  the  results  of  the  previ¬ 
ous  study,  and  compared  the  activation  maps 
from  the  VE  and  moving  pictures  using  fMRI. 

Method: 

20  subjects  who  are  right  handed  are  going  to 
be  recruited  and  divided  into  two  groups.  One 
group  will  be  exposed  to  VE  and  the  other  to 
moving  pictures.  Each  subject  will  be  required 
to  fill  out  a  questionnaire  that  asks  for  the  sub¬ 
ject’s  level  of  nicotine  craving  before  and  after 
the  experiment,  so  that  the  changes  can  be  ob¬ 
served.  A  1 .5  T  GE  MRI  machine  in  Hanyang 
University  Kuri  Hospital,  Korea,  will  be  used  to 
gather  fMRI  data  and  a  subject  in  the  magnet 
will  be  able  to  see  a  visual  stimulus  (VE  or  mov¬ 
ing  pictures)  through  MR  compatible  HMD 
(Resonance  Inc.).  The  block  design  will  be  used 
and  the  data  will  be  analyzed  with  SPM99. 

Results: 

Although  the  experiment  and  the  data  analysis 
are  still  in  progress,  we  are  able  to  predict  that 
the  areas  which  are  involved  in  the  process  of 
the  visuo-spatial  attention,  memory,  and  craving 
would  be  activated,  such  as  right  intra-parietal 
sulcus,  posterior  hippocampus  (bilateral),  me¬ 
dial  thalamus  (bilateral),  right  ventral  tegmental 
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area,  right  posterior  amygdala,  right  inferior 
frontal  gyrus,  and  middle  frontal  gyrus  (bilateral) 
[2]  and  these  areas  are  more  activated  in  VE 
session. 

Conclusion: 

We  proposed  a  VE  that  can  be  used  in  CET  to 
induce  nicotine  craving,  and  our  results  would 
show  stronger  brain  activations  in  VE  than 
those  in  moving  pictures.  It  might  be  able  to 
support  the  belief  that  Virtual  Reality  (VR)  is  a 
more  effective  method  of  CET.  VR  can  provide 
a  multi-modal  environment  that  requires  one’s 
cognitive  ability  such  as  spatial  attention  and 
memory  in  order  to  interact,  causing  a  higher 
level  of  craving. 
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Research  Status:  Completed 

Preliminary  clinical  evidence  suggests  that  at 
least  for  brief  (3-6  minute)  treatment  durations, 
Virtual  Reality  is  surprisingly  effective  for  reduc¬ 
ing  extreme  pain.  VR  has  reduced  pain  by  as 
much  as  50%  during  brief  burn  wound  care  and 
physical  therapy  treatments.  The  present  labo¬ 
ratory  pain  pilot  study  introduced  a  new  labora¬ 
tory  pain  paradigm  combining  thermal  and  elec¬ 
trical  pain  to  allow  the  study  of  longer  pain  ses¬ 
sions.  We  explored  whether  VR  works  for 
longer  durations  with  multiple  treatments  per 
subject.  The  virtual  environment  titled  Snow- 
World  was  used.  Aiming  with  her  head- 
position-tracked  gaze,  the  subject  shot  snow¬ 
balls  at  snowmen,  igloos,  robots  and  penguins 
by  pressing  a  button.  During  each  session,  four 
thermal  pain  stimuli  lasting  thirty  seconds  each 
were  interleaved  with  four  electrical  pain  stimuli 
lasting  two  minutes  each,  administered  over  a 
period  of  25  minutes.  Using  subjective  0-10 
graphic  rating  scales,  after  each  brief  stimulus, 
our  healthy  19  year  old  female  volunteer  rated 
three  aspects  of  her  pain:  1)  the  amount  of  time 
spent  thinking  about  pain,  2)  pain  unpleasant¬ 
ness,  and  3)  worst  pain.  Comparing  thermal 
pain  during  baseline  (no  VR)  to  mean  thermal 
pain  during  VR  treatment,  “time  spent  thinking 
about  pain”  dropped  from  9  to  2.5,  “pain  un¬ 
pleasantness”  dropped  from  9  to  2.5,  and  “worst 
pain”  dropped  from  9  to  3.2.  Comparing  electri¬ 
cal  pain  during  baseline  (no  VR)  to  mean  elec¬ 
trical  pain  during  treatment  (during  VR),  “time 
spent  thinking  about  pain”  dropped  from  9.5  to 
1 .25,  “pain  unpleasantness”  dropped  from  8  to 
3,  and  “worst  pain”  dropped  from  7.5  to  3.4. 
This  pattern  of  strong  pain  during  “no  VR”  base¬ 
line  and  large  drops  in  pain  ratings  while  in  VR 
was  replicated  on  several  subsequent  days  for 
the  one  subject  who  received  VR.  Four  control 
subjects  received  no  VR  at  all.  As  predicted, 
they  showed  high  pain  ratings  during  baseline 
and  throughout  their  25  minute  sessions,  and 
this  pattern  of  consistent,  high  pain  ratings  was 
found  on  all  six  25-minute  sessions  per  control 
subject.  While  small  studies  are  inconclusive  by 
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nature,  these  results  are  encouraging  prelimi¬ 
nary  evidence  that  VR  reduces  pain  for  longer 
(clinically  relevant)  treatment  durations,  and  VR 
analgesia  appears  to  remain  effective  with  re¬ 
peated  use.  Simulator  sickness  was  negligible 
for  this  subject,  and  her  rating  of  presence  in 
VR  was  consistently  “strong”.  A  larger  controlled 
laboratory  study  is  currently  underway. 

Novelty/Discussion: 

This  is  the  longest  duration  of  VR  analgesia  by 
our  group  to  date  and  introduces  a  new  tech¬ 
nique  for  safely  inducing  multiple  etiology 
(thermal  and  electrical)  laboratory  pain  for  pro¬ 
longed  treatment  periods. 
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Research  Status:  Preliminary  results 

Background: 

It  is  often  that  we  attempt  to  measure  cognitive 
processes  within  the  context  of  a  virtual  environ¬ 
ment  (VE),  such  as  complex  sensory  process¬ 
ing,  attentional  ability,  spatial  cognition  and 
memory.  Collectively,  these  contribute  to  and 
influence  the  “feeling  of  presence.”  In  this  study, 
we  investigated  the  relation  between  presence 
and  brain  activation  using  functional  magnetic 
resonance  imaging  (fMRI).  We  hypothesized 
that  the  activity  in  brain  regions  responsible  for 


sensory  integration,  as  well  as  attention  proc¬ 
essing,  could  be  influenced  by  changes  in  pres¬ 
ence  score.  This  was  based  on  the  conceptual 
model  that  VE  enrichment  through  use  of  multi¬ 
modal  stimuli  could  enhance  the  feeling  of  pres¬ 
ence.  To  test  the  hypothesis,  we  designed  an 
fMRI-compatible  data  glove  that  can  provide 
vibrotactile  stimulation,  and  performed  fMRI  ex¬ 
periments  to  investigate  the  changes  in  brain 
activity  and  presence  score  produced  by  touch¬ 
ing  a  virtual  object  with  and  without  vibrotactile 
feedback. 

Methods: 

Four  young,  healthy,  right-handed  subjects  (1 
male,  3  female,  average  age  is  25.25  (sd=3.86)) 
underwent  fMRI  at  3.0  Tesla  magnetic  field 
strength.  They  experienced  7  tasks  in  pseudo¬ 
random  order:  “see”  virtual  object,  “feel”  vibra¬ 
tions,  self-paced  finger  “tapping”,  “touchl  and 
touch2”  (touch  virtual  object  with  /  without  vibro- 
tactile  feedback),  and  “touch3  and 
touch4"  (touch  a  vibrating  virtual  object  with  / 
without  vibrotactile  feedback).  Brain  activity  for 
the  group  was  assessed  in  a  mixed-effect 
analysis.  Using  a  photo-plethysmograph 
mounted  on  the  MRI  system,  heart  rate  variabil¬ 
ity  (HRV)  data  was  recorded  throughout  and 
analyzed  to  yield  the  low  frequency  to  high  fre¬ 
quency  ratio  (LF/HF)  as  a  representation  of 
arousal.  After  fMRI,  the  subjects  completed 
questionnaires  to  assess  their  subjective  level 
of  presence  (0  to  10)  in  each  task. 

Results: 

Mean  presence  scores  tended  to  be  higher  for 
tasks  that  included  vibrotactile  feedback  com¬ 
pared  to  those  that  did  not.  Mean  LF/HF  ratios 
showed  a  similar  effect.  For  all  “touch"  tasks, 
left  precentral  gyrus  (primary  motor  area),  infe¬ 
rior  parietal  lobule,  medial  frontal  gyrus,  and 
occipital  lobe  showed  activity.  Areas  known  to 
be  involved  in  sensory  integration  and  attention 
processing  (left  anterior  cingulate,  left  middle 
frontal  gyrus,  and  right  insula)  showed  changes 
in  activity  between  touchl  and  touch2  tasks, 
and  between  touch3  and  touch4  tasks. 

Conclusion: 

In  this  study,  consistent  changes  in  HRV  and 
brain  activation  were  observed,  related  to  differ¬ 
ent  feelings  of  presence  in  a  virtual  touching 
task,  and  linked  to  the  processes  of  sensory 
integration  and  attention.  Further  investigation, 
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including  a  larger  number  of  volunteers  is  re¬ 
quired.  Nonetheless,  these  preliminary  results 
support  the  notion  that  the  observed  brain  acti¬ 
vation  is  consistent  with  a  component  of  the 
conceptual  model  of  presence,  i.e.  “system  en¬ 
richment,”  which  can  draw  one’s  attention  and 
increase  one’s  involvement  and  feeling  of  pres¬ 
ence.  Such  experiments  additionally  provide  an 
important  window  on  the  ecological  validity  of 
VR  applications  in  clinical  psychology. 
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Research  status:  In  Progress 

Objective: 

The  aim  of  this  study  is  the  implementation  of  a 
virtual  reality  (VR)  system  that  can  assess  the 
state  of  disease  and  train  the  hemispatial  ne¬ 
glects  to  affect  visual  stimulation.  The  virtual 
environment  provided  by  the  system  is  mater- 
nalized  with  3-dimensional  computer  graphics, 
which  is  similar  to  the  branch  road.  There  is  a 
target  ball  which  guides  subjects'  gaze  while  the 
target  ball  moves  randomly  to  the  right  or  left 
from  the  user's  viewpoint.  In  this  experiment, 
the  patients  should  chase  the  movement  of  the 
ball.  The  task  level  is  utilized  in  order  to  assess 
the  patients'  characteristics  from  this  result.  The 
training  task  level  is  predetermined. 

Method/Tools: 


System: 

The  VR  System  consists  of  Pentium  IV  PC, 
DirectX  3D  Accelerator  VGA  Card,  HMD  (Eye 
Trek  -  OLYMPUS),  and  3DOF  Position  Sensor 
(Intertrax2)  The  PC  with  3D  Accelerator  VGA 
Card  generates  real-time  virtual  images  for  sub¬ 
jects  to  navigate.  The  position  sensor  transfers 
a  subject's  head  orientation  data  to  the  com¬ 
puter. 

Virtual  environment: 

We  built  the  branch  road  so  that  the  ball  is  lo¬ 
cated  in  the  center  of  the  road.  The  subject's 
gaze  is  guided  as  the  ball  moves  in  a  random 
direction.  The  ball  changes  color  if  the  patient 
looks  at  the  ball.  This  change  awakens  the  vis¬ 
ual  attention  of  the  patient. 

Tasks  in  the  Virtual  Environment: 

Our  program  is  composed  of  3  stages  with  4 
levels  for  differentiating  the  training  according  to 
the  characteristics  of  the  patient.  The  level  is 
distinguished  by  the  speed  of  the  ball.  If  the  pa¬ 
tient  succeeds  at  the  same  level  three  times, 
then  the  patient  moves  on  to  the  next  level. 
There  are  3  cues  in  one  level  and  each  cue 
happens  according  to  each  time  passage.  Pa¬ 
tients  pass  to  the  next  stage  if  they  succeed  in 
all  four  levels.  The  3  stages  are  divided  by  vis¬ 
ual  angle. 

Results: 

Left  side  neglect  patients  show  a  neglect  ex¬ 
pression  angle  more  deviated  toward  the  left 
side  than  normal  subjects.  This  result  supports 
the  correlation  of  the  VR  system  with  neglect 
evaluation  tools  such  as  the  line  bisection  test 
and  the  letter  cancellation  test.  Attention  time 
and  scanning  time  are  increased  in  the  left  side 
neglect  patient  who  has  a  deficit  in  attention, 
midline  orientation,  and  neck  rotation  ability.  If  a 
patient  steadily  performs  the  training  program, 
we  expect  that  the  symptoms  of  the  patient  will 
improve. 

Novelty/Discussion: 

The  VR  system  has  more  benefits  than  previous 
neglect  evaluation  tools.  This  system  provides 
high  ecological  validity  by  3-dimensional  com¬ 
puter  graphics  that  are  similar  to  the  real  world, 
and  assesses  data  that  can  be  acquired  while 
the  patient  reacts  immediately  to  various  stimuli. 
The  data  is  used  to  diagnose  the  condition  of 
the  patient.  However,  statistical  analysis  about 
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the  data  is  difficult  because  subjects  are  scarce. 
Thus,  we  will  progress  the  clinical  test  continu¬ 
ally  in  the  patients  with  unilateral  neglect. 

Heilman,  KM.,  Watson,  RT.,  and  Valenstein,  E. 
(1985):  Neglect  and  related  disorders.  In: 
Heilman  KM,  Valenstein  E,  editors.  Clinical 
Neuropsychology.  2nd  ed,  New  York:  Ox¬ 
ford. 

Zoltan,  B.,  Vision.  (1996):  Perception,  and  Cog¬ 
nition:  A  manual  for  the  Evaluation  and 
Treatment  of  the  Neurologically  Impaired 
Adult,  3rd  ed.  New  Jersey:  SLACK. 

Weinberg,  J.,  et  al.(1 979):  Training  sensory 
awareness  and  spatial  organization  in  peo¬ 
ple  with  right  brain  damage.  Arch  Phys  Med 
Rehabil.  60:491-6. 

Contact:  Jang  Han  Lee. 

Sungdong  P.O.  Box  55, 

Seoul,  KOREA  133-605 
email:  clipsy@bme.hanyang.ac.kr 
Tel:822-2291-1675 
Fax:  822-22965943 


Presenter:  Fabrizia  Mantovani,  Ph.D. 

Narrative  Dimension,  Sense  of  Presence  and 
Emotional  Involvement:  An  Experimental 
Analysis 

F.  Mantovani,  Ph.D.1'2,  M.  Mauri,  M.S.1,  G.  De 
Leo,  Ph.D.1,  M.  Mantovani  B.S.1,  G.  Castel- 
nuovo,  M.S.1'3,  A.  Gaggioli,  M.S.1'4 * * * * * * *,  G.  Riva, 
Ph.D. 12 

1  Applied  Technology  for  Neuro-Psychology  Lab., 

Istituto  Auxologico  Italiano,  Verbania,  Italy 

2  Department  of  Psychology,  Catholic  University,  Mi¬ 

lan,  Italy 

3  Laboratory  of  Psychology,  Department  of  Preclinical 

Sciences  LITA  Vialba,  Faculty  of  Medicine  and 

Surgery,  University  of  Milan,  Milan,  Italy. 

Research  status:  In  Progress 

Background: 

A  number  of  studies  in  the  field  [1]  have  clearly 

shown  that  Virtual  Reality  (VR)  can  be  a  power¬ 

ful  tool  within  a  psychotherapeutic  intervention. 

In  particular,  a  critical  feature  for  a  clinical  Vir¬ 

tual  Environment,  now  under  investigation  by 


the  European  Project  EMMA  -  Engaging  Media 
for  Mental  Health  Applications  (http:// 
www.emma.upv.es/),  is  its  ability  of  inducing 
presence  and  emotions  in  users  [2].  A  recent 
model  of  presence  [3]  described  it  as  a  defining 
feature  of  self,  related  to  the  evolution  of  a  key 
feature  of  any  central  nervous  system:  the 
separation  between  an  external  world  and  the 
internal  one.  If  in  simple  organisms,  this  process 
involves  only  a  correct  coupling  between  per¬ 
ceptions  and  movements  (movement  tracking), 
in  humans  it  also  requires  the  shift  from  mean- 
ing-as-comprehensibility  to  meaning-as- 
significance,  with  meaning-as-significance  refer- 
ing  to  the  value  or  worth  of  the  event  for  us.  For 
a  patient,  “his/her  events”  are  only  the  ones  that 
are  meaningful  for  him/her.  Following  this  vi¬ 
sion,  an  important  role  for  inducing  a  high  level 
of  presence  could  be  played  not  only  by  sys¬ 
tem-related  features  such  as  graphic  realism, 
level  of  immersion  and  interaction  devices,  but 
also  by  the  setting  of  the  VR  experience  within  a 
meaningful  narrative  context,  favoring  user 
identification  and  involvement.  However,  few 
systematic  and  controlled  studies  aimed  at  in¬ 
vestigating  the  complex  relationships  of  these 
dimensions  have  been  carried  out. 

Method/Tools: 

The  main  objective  of  the  presented  research  is 
the  study  of  the  influence  of  narrative  dimension 
and  level  of  immersion  on  sense  of  presence, 
emotional  involvement  and  psycho- 
physiological  arousal,  within  a  virtual  reality  ex¬ 
perience.  40  subjects  (female  university  stu¬ 
dents  between  20  and  25  years  old)  took  part  in 
the  study.  Experimental  design  (a  2x2  between 
subjects  design)  included  two  independent  vari¬ 
ables:  1.  presence  vs  absence  of  narrative  con¬ 
text  and  2.  immersive  (Head-Mounted  Display) 
vs  non-immersive  condition.  Dependent  vari¬ 
ables  were  sense  of  presence,  measured 
through  ITC-SOPI  questionnaire  [4],  emotional 
experience  measured  through  Positive  and 
Negative  Affect  Scale  (PANAS)  [5],  and  psycho- 
physiological  indexes  such  as  heart  rate  (HR) 
and  galvanic  skin  response  (GSR). 

Conclusions: 

Preliminary  data  support  the  vision  of  VR  as  an 
advanced  imaginal  system:  an  experiential  form 
of  imagery  that  could  be  as  effective  as  reality  in 
inducing  emotional  responses.  The  possibility  of 
structuring  a  large  amount  of  real-like  or  imagi- 
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nary  controlled  stimuli  and,  simultaneously,  of 
monitoring  the  possible  responses  generated  by 
the  user  of  the  virtual  world  may  offer  a  consid¬ 
erable  increase  in  the  likelihood  of  therapeutic 
effectiveness,  as  compared  to  traditional  proce¬ 
dures.  However,  the  data  also  suggest  that  the 
clinical  skills  of  the  therapist  and  in  particular, 
his/her  ability  in  creating  a  narrative  context 
(clinical  protocol)  for  the  experience,  remain  a 
critical  factor  for  the  successful  use  of  VR  sys¬ 
tems. 

The  present  work  is  supported  by  the  European 
Commission,  in  particular  by  the  1ST  program: 
Project  EMMA-  Engaging  Media  for  Mental 
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Research  status:  Almost  complete 

Background: 

Current  studies  in  our  lab,  as  well  as  those  at 
other  centers,  have  reported  significant  correla¬ 
tions  between  presence  and  anxiety.  But  the 
direction  of  the  causal  relationship  between  the 
two  constructs  remains  to  be  tested:  does  pres¬ 
ence  in  VR  lead  to  anxiety,  or  does  anxiety  lead 
to  presence  in  VR?  The  aim  of  this  study  is  to 
experimentally  manipulate  the  sense  of  pres¬ 
ence  to  test  the  level  of  anxiety  felt  by  phobics 
when  immersed  in  a  virtual  environment. 

Method: 

The  sample  consisted  of  40  people  afraid  of 
heights  who  had  to  perform  a  feared  task  for  1 0 
minutes  while  immersed  on  a  virtual  bridge.  The 
task  involved  contemplating  a  15-story  building 
under  construction,  selecting  which  floor  to  exit, 
taking  the  elevator  to  the  selected  level,  exiting 
the  elevator  and  walking  on  a  scaffold  crossing 
the  streets,  hit  a  plank  and  watching  it  while  it 
falls,  see  an  airplane  and  turn  back. 

The  participants  were  randomly  assigned  to  two 
conditions:  (a)  High  Presence  First  (High-PF; 
the  task  was  conducted  in  a  setting  that  maxi¬ 
mized  presence),  and  (b)  Low  Presence  First 
(Low-PF;  the  task  was  conducted  in  a  setting 
that  disrupted  presence).  The  study  used  a  re¬ 
peated  measure  factorial  design  where  the 
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tasks  were  performed  once  in  each  setting,  in  a 
reversed  order  between  the  conditions  (High-PF 
and  Low-PF).  To  maximize  presence,  partici¬ 
pants  were  immersed  in  VR  with  a  dark  cloth 
covering  a  Cy-Visor  HMD,  in  a  dark  and  quiet 
room.  In  the  other  setting,  the  HMD  was  not 
covered  by  a  black  cloth  (participants  could  see 
the  room  around  them),  the  lights  were  turned 
on  and  music  was  playing  in  the  background. 

The  following  questionnaires  were  used:  the 
Immersive  Tendencies  Questionnaire 
(assessing  subjects’  predisposition  to  feel  im¬ 
mersed  in  VR),  the  Simulator  Sickness  Ques¬ 
tionnaire  (measuring  cybersickness),  the  Pres¬ 
ence  Questionnaire,  the  State-Trait  Anxiety  In¬ 
ventory  and  the  Acrophobic  Questionnaire. 

The  equipment  used  includes:  an  IBM  Pentium 
/l/*0  computer  and  an  ATI-9700  graphics  card. 
A  Cy-Visor  with  a  big  resolution  (1.44  millions 
Pixels)  and  an  lntertrax-ll  tracker  by  Intersense 
were  also  used.  Finally,  the  virtual  environment 
was  created  using  the  Max  Payne  3D  game 
editor.  A  15-floor  building  constitutes  the  envi¬ 
ronment  where  the  subject  can  take  an  elevator. 

Results  and  Conclusions: 

Our  results  showed  that  subjects  are  more  anx¬ 
ious  in  the  High  presence  condition.  This  is  in¬ 
teresting  in  the  context  of  other  results  in  our  lab 
suggesting  that  anxiety  also  affects  presence. 
Thus,  there  seems  to  be  a  synergistic  effect 
between  anxiety  and  presence.  Further  studies 
should  assess  whether  this  effect  also  applies 
to  other  emotions  (e.g.,  sadness,  joy)  and  if  the 
synergistic  effect  follows  a  linear  relationship  or 
is  subjected  to  floor  and  ceiling  effects. 
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Research  Status:  In  Development 
Background/Problem: 

To  effectively  treat  phobias,  therapy  techniques 
must  be  capable  of  producing  an  emotional  re¬ 
sponse  within  a  patient  (Foa,  Steketee,  & 
Rothbaum,  1989).  A  sense  of  presence  induces 
anxiety  when  using  virtual  reality  exposure  ther¬ 
apy,  even  when  there  is  no  actual  threat 
(Rothbaum,  Hodges,  Watson,  Kessler,  &  Up¬ 
dike,  1996).  To  maintain  presence,  virtual  stim¬ 
uli  must  replicate  the  complexities,  scale,  and 
appearance  of  real  world  stimuli  (Rothbaum  & 
Hodges,  1999).  Because  of  the  constraints  of 
real-time  systems  and  production  requirements, 
stimuli  attributes  must  be  prioritized  and  ab¬ 
stracted.  However,  no  systematic  approach  to 
creating  virtual  stimuli  currently  exists.  Our  pres¬ 
entation  demonstrates  a  potential  design  meth¬ 
odology  within  the  context  of  a  larger  project 
treating  snake  phobia  through  virtual  exposure 
therapy. 

Methods/Tools: 

The  methodology  follows  an  iterative  approach 
of  prioritizing,  abstraction,  modeling,  and 
evaluation.  Prioritizing  involves  analyzing  the 
real-world  stimulus  along  with  exposure  therapy 
data  to  identify  key  fear-inducing  features.  Dur¬ 
ing  abstraction,  simplified  design  analogies  dis¬ 
till  these  key  elements  into  manageable  con¬ 
cepts.  A  system  is  then  modeled  around  these 
analogies  to  reproduce  the  stimulus  within  the 
virtual  environment.  Finally,  phobic  patient  test¬ 
ing  evaluates  the  believability  of  the  stimulus. 
Key  elements  that  need  to  be  added  or  im¬ 
proved  are  considered,  and  the  iterative  proc¬ 
ess  is  continued  until  an  acceptable  level  of 
anxiety  production  is  achieved. 

Novelty: 

Key  elements  identified  within  the  real-world 
stimulus  included  locomotion,  tongue  flicker, 
decision-making,  interaction  with  objects,  and 
scale  patterns.  Phobic  patients  often  com¬ 
mented  that  the  way  a  snake  moves  is  a  major 
factor  in  inducing  fear.  Accordingly,  priority  was 
placed  upon  the  movement  model  used.  A 
spring  and  mass  analogy  was  used  to  approxi¬ 
mate  the  muscles  used  in  the  snake’s  move¬ 
ment.  Synthetic  intelligence  techniques  were 
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used  to  produce  realistic  behavior  while  main¬ 
taining  therapist  control.  While  previous  animal 
phobia  treatment  VEs  included  animated  animal 
stimuli  (Garcia-Palacios,  Hoffman,  Carlin, 
Furness,  Botella,  2001),  they  did  not  include 
behavioral  algorithms.  Stochastic  patterns  en¬ 
hanced  the  organic  quality  of  many  features, 
such  as  the  timing  of  the  flickering  tongue.  The 
therapist  was  also  given  control  over  key  behav¬ 
ior  animations,  such  as  the  snake  raising  its 
head  and  smelling  the  air  to  gather  information 
about  the  environment. 

Conclusion/Results: 

Using  a  systematic  approach  produces  virtual 
stimuli,  which  are  effective  in  generating  fear  in 
patients  with  specific  animal  phobias.  Test  sub¬ 
jects  reported  fear  levels  as  high  as  nine  on  the 
Subjective  Units  of  Discomfort  (SUD)  scale.  In 
addition,  four  broad  areas  of  design  heuristics 
emerged.  These  include  the  stimulus’  appear¬ 
ance,  movement,  behavior,  and  interaction.  Be¬ 
havior  is  distinguished  from  interaction  in  the 
sense  that  behavior  is  object  intelligence  while 
interaction  implies  some  form  of  input  from  a 
user  or  the  environment. 

It  is  vital  that  the  object  react  naturally  with  the 
environment  and  vice  versa.  Although  the  snake 
does  not  appear  entirely  realistic  to  the  non¬ 
phobic  user,  it  does  exhibit  the  key  qualities  that 
induce  fear,  making  it  appear  far  more  realistic 
to  phobic  patients.  Thus,  proper  prioritization  of 
attributes  allows  for  a  more  effective  stimulus 
design. 
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Research  Status:  In  Development 
Background/Problem: 

Virtual  reality  exposure  (VRE)  therapy  has  been 
shown  to  be  an  effective  treatment  for  specific 
phobias  VRE  (Rothbaum  &  Hodges,  1999).  This 
project  uses  VRE  in  the  treatment  of  ophidio¬ 
phobia  (fear  of  snakes).  The  reproduction  of  the 
effectiveness  of  graded  exposure  therapy  re¬ 
quired  a  comprehensive  gradation  of  exposure 
and  therapist  input  to  tailor  the  environment  for 
the  needs  of  specific  patients. 

Methods/Tools: 

Our  team  developed  Snake  Phobia  SVE  using 
the  Simple  Virtual  Environment  Library  (SVE). 
SVE  is  an  application  programming  interface 
(API)  (Kessler,  Bowman,  &  Hodges,  2000)  that 
allows  researchers  to  rapidly  develop  immersive 
virtual  environments.  It  includes  useful  exten¬ 
sions  for  controlling  hardware  such  as  head- 
mounted  displays  (HMDs),  tracking  systems, 
and  input  devices.  Richly  detailed  environments 
were  created  to  maximize  the  patient’s  sense  of 
presence  and  thereby  improve  the  success  of 
the  VRE  (Rothbaum  &  Hodges,  1999).  A  unique 
device  produced  by  Measurand  known  as  the 
ShapeTape  allows  users  to  hold  and  manipulate 
a  virtual  snake.  The  ShapeTape  consists  of  a 
long  plastic  strip  embedded  with  fiber-optic  sen- 


183 


sors.  The  virtual  snake  duplicates  the 
ShapeTape  curvature. 

Novelty: 

Designing  realistic  stimuli  was  a  major  focus  of 
the  project.  Combining  synthetic  intelligence, 
physics  based  movement,  advanced  modeling 
and  texturing,  and  therapist  control,  we  created 
a  stimulus  that  was  effective  within  the  con¬ 
straints  of  a  real-time  system. 

Previous  VRE  environments  have  made  use  of 
tactile  props  to  enhance  emotional  response 
(Garcia-Palacios,  Hoffman,  Carlin,  Furness, 
Botella,  2001).  The  input  of  the  props  is  often 
limited  to  position  tracking.  Our  project  extends 
the  idea  of  a  prop  as  an  input  device  with  the 
ShapeTape.  Our  application  is  unique  because 
the  articulation  of  the  prop  is  duplicated  within 
the  environment. 

Because  the  user  is  under  stress,  a  system  of 
navigation  needed  to  be  developed  to  allow  the 
user  to  move  freely  and  accurately  even  when 
in  fear.  We  used  a  system  of  collision  detection 
and  control  paths  to  allow  the  user  to  move 
freely  yet  remain  in  desired  areas. 

The  first  scenario  involves  patients  viewing 
graded  posters  of  snakes  in  a  museum  setting. 
Then  the  patient  progresses  through  a  scenario 
featuring  snakes  in  three  glass  cages.  Each 
snake  is  larger  and  more  aggressive  than  the 
last.  The  next  scenario  occurs  outdoors  in  a 
nature  trail  setting.  Here,  the  graded  attribute  is 
the  confrontation  style;  patients  must  confront 
the  snake  in  increasingly  uncontrolled  ways. 
The  final  scenario  requires  the  patient  to  actu¬ 
ally  handle  the  snake  through  a  tactile  prop. 
Such  a  wide  range  of  interaction  is  generally  not 
exhibited  in  VRE  applications. 

Conclusion/Results: 

A  pilot  user  test  found  the  environment  effective 
in  stimulating  intense  fear  in  a  near-phobic  pa¬ 
tient.  The  therapist  also  found  that  the  system 
complemented  existing  exposure  techniques, 
supporting  the  theory  that  producing  a  robust 
environment  allows  for  a  comprehensive  treat¬ 
ment  scheme.  Current  work  includes  designing 
an  interface  for  the  therapist,  adding  ambient 
sound,  and  conducting  clinical  trials  to  empiri¬ 
cally  determine  effectiveness. 
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Research  status:  In  progress. 

Background: 

Virtual  reality  (VR)  therapy  relies  heavily  on 
what  patients  pay  attention  to  in  immersion.  Be¬ 
cause  the  content  of  the  attention’s  focus  is  so 
central  in  the  use  of  VR  as  a  way  to  induce 
therapeutically  relevant  psychological  states,  it 
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appears  obvious  that  controlling  what  inter¬ 
venes  in  the  perceptual  motor  loop  is  important. 
We  developed  a  method  that  controls  oculomo¬ 
tor  activity  relative  to  selected  virtual  objects’ 
visual  features.  Moreover,  we  are  applying  this 
method  to  study  approach  and  avoidance  be¬ 
havior  dynamics,  i.e.  fluctuations  of  the  oculo¬ 
motor  responses  as  a  function  of  time.  Two 
separate  studies  are  conducted  using  our 
method,  one  aiming  at  assessing  avoidance 
behavior  with  arachnophobic  subjects  facing 
virtual  spiders,  and  another  aiming  at  assessing 
sexual  preferences  with  subjects  of  different 
sexual  orientations  interacting  with  virtual  naked 
models. 

Methods: 

Our  method  relies  upon  a  technological  setting 
including  what  is  usually  necessary  to  present 
virtual  environments  in  immersion,  as  well  as 
equipment  dedicated  to  eye-movement  tracking 
from  within  a  head  mounted  display  (HMD).  A 
special  mounting  built  from  a  monocular  infrared 
eye-tracking  system,  combined  within  a  binocu¬ 
lar  HMD,  is  used  to  track  eye-movements. 
Head-movements  are  recorded  from  a  magnetic 
tracking  system  rendering  the  6  degrees-of- 
freedom  (DOF)  of  translation  and  rotation.  Our 
method  performs  gaze  analysis  by  the  way  of 
virtual  measurement  points  (VMP)  placed  on 
virtual  objects  for  the  analysis  of  eye- 
movements  in  relation  to  specific  features  of 
these  objects.  Gaze  radial  angular  deviation 
(GRAD)  from  the  VMP  is  given  by  the  combina¬ 
tions  of  the  6  DOF  developed  by  head- 
movements  and  the  x  and  y  coordinates  ren¬ 
dered  by  the  eye-tracking  system.  The  VMP  is 
locked  to  virtual  objects  and  moves  jointly  with 
them.  While  the  variations  in  the  6  DOF  devel¬ 
oped  by  head-movements  define  changes  in  the 
global  scene  presented  in  the  HMD,  the  2  DOF 
given  by  the  eye-tracking  device  allow  the  com¬ 
putation  of  the  exact  position  of  the  line  of  sight 
relative  to  the  VMP.  As  other  physiologic  sig¬ 
nals,  we  also  measure  the  subject’s  distance 
from  the  VPR,  the  pupil  size  diameter  and  the 
blinking  response. 

The  3D  stimuli  that  we  used  are  virtual  spiders 
(in  the  arachnophobia  study)  and  naked  human 
models  (in  the  sexual  preferences  study). 

Results: 

Preliminary  results  from  the  arachnophobia  and 


sexual  preferences  studies  will  be  presented. 
These  results  will  consist  in  analyses  performed 
on  time  series  coming  from  oculomotor  re¬ 
sponses  recorded  in  immersion. 

Novelty: 

These  results  inscribe  themselves  in  the  exten¬ 
sion  of  our  past  studies  whose  goal  was  mainly 
to  make  sense  of  the  perceptual  and  motor  di¬ 
mensions  of  virtual  immersion  (Renaud  et  al., 
2001;  Renaud  et  al.,  2002  a,  c).  Nevertheless, 
they  help  to  circumscribe  more  precisely  the 
perceptual  motor  dynamics  by  adding  measures 
of  oculomotor  activities  and  by  looking  at  how 
these  measures  relate  to  the  valence  and  affor- 
dance  of  virtual  stimuli  (Renaud  et  al.,  2002  b; 
Renaud  et  al.,  2003). 

Renaud,  P.,  Bouchard,  S.,  &  Proulx,  R.  (2002 
a).  Behavioral  avoidance  dynamics  in  the 
presence  of  a  virtual  spider.  IEEE  (Institute 
of  Electrical  and  Electronics  Engineers). 
Transactions  in  Information  Technology  and 
Biomedicine.  6  (3):  235-243. 

Renaud,  P.,  Cusson,  J.-F.,  Bernier,  S.,  Decarie, 
J.,  Gourd,  S.-P.,  &  Bouchard,  S.  (2002  b). 
Extracting  perceptual  and  motor  invariants 
using  eye-tracking  technologies  in  virtual 
immersions.  Proceedings  of  HAVE'2002- 
IEEE  (Institute  of  Electrical  and  Electronics 
Engineers)  International  Workshop  on  Hap¬ 
tic  Virtual  Environments  and  their  Applica¬ 
tions,  Ottawa.  73-78. 
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L.-C.,  &  Bouchard,  S.  (2003,  accepted). 
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The  VRTherapy  Project:  Free  Virtual  Reality 
Tools  for  Mental  Health  Therapists 
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Research  status:  In  Progress 
Background: 

In  the  last  five  years  there  has  been  a  steady 
growth  in  the  use  of  virtual  reality  (VR)  in  health 
care  due  to  the  advances  in  information  technol¬ 
ogy  and  the  decline  in  costs.  Much  of  this 
growth  however,  has  been  in  the  form  of  feasi¬ 
bility  studies  and  pilot  trials.  Why  is  the  impact 
of  VR  in  health  care  still  so  limited?  There  are 
three  possible  answers.  First,  there  is  a  lack  of 
standardization  in  VR  devices  and  software. 
Secondly,  there  is  a  similar  lack  in  standardized 
protocols  that  can  be  shared  by  the  community 
of  researchers.  If  we  check  the  clinical  literature, 
we  can  find  only  four  published  clinical  proto¬ 
cols:  for  the  treatment  of  eating  disorders  (1), 
fear  of  flying  (2),  fear  of  public  speaking  (3)  and 
panic  disorders  (4).  Finally,  the  costs  required 
for  the  set-up  trials  are  somewhat  daunting.  Ac¬ 
cording  to  the  European  funded  project  VEPSY 
Updated,  the  cost  required  for  designing  a  clini¬ 
cal  VR  application  from  scratch  and  testing  it  on 
clinical  patients  using  controlled  trials  may 
range  between  US$150,000  and  US$200,000. 

Tools: 

The  significant  advances  in  PC  hardware  that 


have  been  made  over  the  last  five  years  are 
transforming  PC-based  VR  into  a  reality.  The 
cost  of  a  basic  desktop  VR  system  has  de¬ 
creased  by  thousands  of  dollars  since  that  time, 
and  the  functionality  has  improved  dramatically 
in  terms  of  graphics  processing  power.  A  simple 
immersive  VR  system  now  may  cost  less  than 
US$6,000  without  the  software. 

To  support  the  use  of  VR  in  mental  health  care, 
the  Applied  Technology  for  Neuro-Psychology 
Lab,  in  cooperation  with  the  VEPSY  Updated 
project,  the  VRHealth  Company  and  the  Interac¬ 
tive  Media  Institute  launched  the  VRTherapy 
Project  (http://www.cvbertherapy.info;  http:// 
www.vrtherapy.org)  whose  main  goal  is  to  pro¬ 
vide  free  advanced  VR  software  to  qualified 
therapists.  The  first  available  VEs  will  support 
the  treatment  of  Panic  Disorders.  In  particular,  it 
will  be  possible  to  download  the  following  off  of 
the  project’s  site: 

•  pre-tested  virtual  environments  (VEs)  to¬ 
gether  with  their  therapeutic  protocols  and 
the  results  of  their  use  in  controlled  clinical 
trials; 

•  customizable  virtual  environments.  The 
therapist,  using  an  on-line  interface,  will  be 
able  to  add  his/her  own  images. 

The  distributed  software  will  be  available  for 
both  PCs  and  Pocket  PC  PDAs. 

Conclusions: 

In  most  circumstances,  the  clinical  skills  of  the 
therapist  remain  the  most  important  factor  in  the 
successful  use  of  VR  systems.  It  is  clear  that 
the  free  availability  of  different  virtual  environ¬ 
ments  is  important  so  therapists  will  start  to  ap¬ 
ply  these  tools  in  their  day-to-day  clinical  prac¬ 
tice.  The  VRTherapy  projects  aims  at  support¬ 
ing  this  possibility. 
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The  Virtual  Environments  (VE)  Laboratory  at  the 
University  of  Southern  California  (USC)  contin¬ 
ues  to  evolve  its  research  program  aimed  at 
developing  graphics-based  virtual  reality  (VR) 
technology  applications  for  the  study,  assess¬ 
ment,  and  rehabilitation  of  cognitive  and  func¬ 
tional  processes  and  pain  distraction  in  children. 
Our  development  work  also  includes  360  De¬ 
gree  Panoramic  Video  environments  designed 
to  address  Anger  Management  and  Social  Pho¬ 
bia.  We  will  review  the  status,  issues  and  re¬ 
sults  from  studies  using  the  Virtual  Classroom, 


Virtual  Office,  Virtual  Pain  Distraction  Scenario 
and  our  Panoramic  work. 

Highlights  to  be  presented  include: 

1.  Virtual  Classroom  -  Development  of  a 
package  of  11  cognitive  tests,  a  head 
tracked  performance  record  visualization 
tool  and  issues  surrounding  commercial 
development.  This  will  also  include  a  pres¬ 
entation  of  the  latest  version  of  our  Psy¬ 
chological  Corporation  application  and 
early  results  from  the  prototype  testing 
and  standardization  trials. 

2.  Virtual  Office  -  Review  of  the  Data  from  a 
completed  study  at  the  Kessler  Medical 
Rehabilitation  Research  Center  comparing 
traumatic  brain  injured  subjects  with  nor¬ 
mal  controls  on  an  ecologically  valid 
measure  of  everyday  memory  perform¬ 
ance. 

3.  Virtual  Home  -  Demonstration  of  a  NEW 
environment  created  with  advanced  gam¬ 
ing  development  toolkits  that  are  being 
applied  at  two  sites  to  study  prospective 
memory  patients  with  TBI  and  Parkinson’s 
Disease. 

4.  Pain  Distraction  Scenario  -  Data  from  an 
“art-based”  VR  scenario  being  tested  with 
children  who  are  fearful  of  venipuncture 
procedures. 

5.  Panoramic  Video  applications  -  latest  de¬ 
velopment  status  of  Anger  and  Social  pho¬ 
bia  applications  that  involve  “blue-screen” 
capture  of  human  characters  that  can  be 
realistically  pasted  into  fixed  scenario 
backgrounds.  This  will  include  the  discus¬ 
sion  of  projects  at  two  sites  that  are  testing 
emotional  arousal  in  the  anger  manage¬ 
ment  scenarios. 

6.  Commercial  trials  and  tribulations  -  this 
part  of  the  talk  will  cover  some  of  the  is¬ 
sues  we  have  encountered  with  efforts  to 
develop  commercial  applications.  This 
non-traditional  presentation  will  cover  a 
wide  range  of  topics  with  key  findings  and 
observations  in  each  area  being  briefly 
reviewed. 
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The  Relationship  Between  Anxiety  and 
Presence 
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Research  status:  Complete 

Background: 

VR  can  be  used  to  provide  therapeutic  expo¬ 
sure  to  phobogenic  stimuli  for  phobic  clients. 
Some  researchers  use  the  intensity  of  emo¬ 
tional  reactions  in  VR  as  indices  of  the  sense  of 
presence  (e.g.  Meehan,  2001),  while  others  ar¬ 
gue  that  presence  and  emotions  are  totally  in¬ 
dependent  concepts  (i.e.  orthogonal  constructs; 
Slater,  2003).  The  goal  of  this  study  is  to  assess 
the  relationship  between  anxiety  and  presence 
in  order  to  shed  some  light  on  this  debate. 

Method/Tools: 

Thirteen  phobic  participants  and  13  non-phobic 
control  participants  were  immersed  in  a  10- 
minute  phobogenic  task.  The  virtual  environ¬ 
ments  were  generated  on  a  Pentium  III®  866 
Mhz  PC  and  displayed  in  an  1-Glass®  HMD. 
Tracking  was  provided  by  an  Intertrax2®  tracker. 

Results: 

Results  indicate  evidence  of  a  synergistic  rela¬ 
tionship  between  presence  and  anxiety,  as  well 
as  a  greater  tendency  for  phobics  to  experience 
both  anxiety  and  presence.  Correlations  and 
regressions  also  show  that  anxiety  is  associated 
with  presence.  A  linear  regression  was  per¬ 
formed  with  mean  Presence  (dependant  vari¬ 
able)  and  eight  variables  (e.g.  anxiety,  immer¬ 
sive  tendencies).  Results  indicate  that  Anxiety 
self-ratings  were  the  most  important  predictor 
(part  correlation  =  .33).  A  stepwise  regression 
was  performed  with  mean  Presence  self-rating 
(dependent  variable)  and  the  eight  other  vari¬ 
ables.  It  was  found  that  the  optimal  model  used 
only  mean  Anxiety  to  predict  mean  Presence 
(part  correlation  =  .741).  Stepwise  regression 
was  performed  with  mean  Anxiety  as  the  de¬ 
pendent  variable.  This  time,  the  FSS-II-F  Total 
scale  was  entered  to  represent  the  pre¬ 


exposure  anxiety  scales,  and  the  ITQ-F  scales 
and  post-exposure  scales  were  entered  in  a 
stepwise  fashion.  The  optimal  model  produced 
by  this  procedure  included  three  predictors: 
FSS-II-F  Total,  mean  Presence,  and  ITQ-F  To¬ 
tal  with  part  correlation  coefficients  of  .251, 
.506,  and  .287  respectively.  Anxiety  is  highly 
correlated  with  Presence,  and  it  is  the  best  pre¬ 
dictor  of  Presence. 

Conclusion: 

These  results  indicate  that  anxiety  at  the  time  of 
the  VR  experience  is  closely  related  to  sense  of 
presence.  We  also  agree  with  Slater’s  conten¬ 
tion  that  emotion  and  presence  are  conceptually 
distinct,  but  these  results  indicate  that  they  are 
linked  empirically  and  not  orthogonally.  Al¬ 
though  this  study  has  demonstrated  an  empiri¬ 
cal  link  between  emotion  and  presence,  the  un¬ 
derlying  reason  for  this  link  remains  unclear. 
There  are  at  least  three  causal  models  that  are 
consistent  with  this  study’s  results  that  will  be 
suggested.  Further  research  is  required  to  dis¬ 
tinguish  between  these  models.  Experiments 
are  planned  in  which  anxiety  and  presence  will 
be  manipulated  independently  to  show  if  either 
factor  causes  the  other. 

Contact:  Genevieve  Robillard,  M.Sc. 
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Research  status:  In  progress 

Background: 

The  application  of  virtual  reality  in  the  treatment 
of  mental  disorders  is  quite  recent  and  it  already 
seems  to  be  an  efficient  method,  especially  for 
anxiety  disorders.  However,  to  be  efficient  it  is 
necessary  that  the  client  feels  immersed  and 
present  in  the  virtual  environment.  For  this  rea- 
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son,  therapists  are  using  different  strategies  to 
foster  presence,  such  as  giving  a  context  for  the 
immersion  (e.g.,  you  are  going  to  take  a  flight 
from  San  Diego  to  LA)  or  making  suggestions 
(e.g.,  be  careful  not  to  fall  from  the  cliff,  the  au¬ 
dience  is  listening  to  you  now).  The  goal  of  this 
study  is  to  assess  the  effect  of  different  types  of 
instructions  on  the  feeling  of  presence:  minimal 
instructions,  the  addition  of  a  story  context,  the 
addition  of  suggestions  about  senses  “felt”  dur¬ 
ing  the  immersion  or  a  combination  of  all  three. 
Our  hypothesis  is  that  giving  a  context  to  the 
immersion  and  making  suggestions  about  the 
senses  stimulated  during  the  immersion  should 
increase  the  feeling  of  presence. 

Method/tools: 

The  virtual  immersion  was  conducted  using  a 
Windows-based  environment  running  on  a  Pen¬ 
tium  III  (866  MHz)  equipped  with  a  ATI  Radeon 
64  video  card,  an  1-Glass  VGA  HMD  (640  X 
480),  an  Intertrax2  motion  tracker  and  a  joy¬ 
stick.  The  virtual  environment  was  created  by 
modifying  the  map  The  Temple  of  Horus  from 
the  3D  game  Unreal  Tournament.  During  the 
experiment,  participants  had  to  visit  a  practice 
virtual  environment  for  two  minutes  to  become 
familiar  with  how  to  use  the  controls,  and  then 
follow  a  guided  tour  of  the  Temple  of  Horus  for 
five  minutes.  Four  experimental  conditions  were 
provided  for  the  guided  tour:  (a)  minimal  instruc¬ 
tions  (MIN;  “Please  visit  the  Temple  of  Horus  by 
following  the  candles  that  are  lit  to  guide  you”); 
(b)  minimal  instructions  and  a  story  that  gives  a 
context  to  the  immersion  in  the  virtual  environ¬ 
ment  (STORY;  a  description  of  the  Egyptian 
god  Horus  and  the  history  of  his  temple);  (c) 
minimal  instructions  and  suggestions  about  the 
senses  stimulated  by  the  virtual  environment 
(SUGG;  e.g.,  “be  careful  not  to  fall  when  going 
down  the  stairs,  it  is  slippery”);  (d)  minimal  in¬ 
structions,  information  about  the  context  of  the 
visit,  and  suggestions  about  the  senses  stimu¬ 
lated  by  the  virtual  environment  (ALL).  Partici¬ 
pants  were  randomly  assigned  to  the  four  condi¬ 
tions  and  completed  measures  of  immersive 
tendencies,  presence,  realism  and  cybersick¬ 
ness. 

Results  and  Conclusions: 

The  preliminary  results  of  this  study  (still  in  pro¬ 
gress,  N=57  adults  from  the  normal  population) 
failed  to  show  any  significant  differences  on  the 
measures  of  presence  between  all  four  condi¬ 


tions.  Thus,  it  seems  that  what  is  said  by  the 
experimenter  during  an  immersion  in  a  virtual 
environment  may  not  have  a  strong  impact  on 
the  participant’s  feeling  of  presence.  These  re¬ 
sults  highlight  the  importance  of  factors  that  are 
contributing  to  feelings  of  presence,  such  as 
quality  of  the  interface,  possibilities  of  interact¬ 
ing  with  the  virtual  environment,  or  the  number 
of  senses  stimulated  by  the  virtual  environment. 

Contact:  catousabou@hotmail.com 
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Background: 

According  to  Lang  (1979),  fear  is  represented  in 
memory  as  informational  structures  including  (1) 
information  about  feared  stimuli,  (2)  information 
about  verbal,  physiological  and  motor  re¬ 
sponses,  and  (3)  information  about  the  mean¬ 
ing.  The  effective  treatment  for  specific  phobias 
involves  modification  of  these  informational  fear 
structures  through  “emotional  process¬ 
ing”  (activation  and  modification  of  the  struc¬ 
tures  through  guided  exposure  and  provision  of 
information  incompatible  with  the  preexisting 
one).  An  important  parameter  for  emotional 
processing  is  the  degree  of  activation  of  the  fear 
structures  during  exposure,  which  depends  on 
the  number  of  systems  involved.  An  optimal 
level  is  achieved  when  every  response  system 
is  active,  with  the  patient  expressing  physiologi¬ 
cal  arousal,  self-reported  fear  and  avoidance. 

The  efficacy  of  Virtual  Reality  Exposure  Ther¬ 
apy  for  the  treatment  of  specific  phobias  is  well 
documented  in  the  literature  (Glantz  et.al,  2003, 
Wiederhold  &  Wiederhold,  2003,  Rothbaum  et 
al,  2002).  Although  the  outcomes  are  compel¬ 
ling,  the  literature  is  lacking  regarding  the  de¬ 
gree  to  which  the  exposure  to  virtual  environ- 
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merits  produces  activation  of  the  fear  structures, 
an  important  precondition  for  emotional  proc¬ 
essing. 

Based  on  these  assumptions,  this  study 
(currently  in  progress)  presents  a  procedure  for 
the  assessment  of  activation  of  fear  structures 
during  exposure  to  a  virtual  environment  de¬ 
signed  for  the  treatment  of  acrophobia. 

Method: 

Fifteen  subjects  diagnosed  with  acrophobia  us¬ 
ing  ADIS-IV  and  15  control  subjects  without  ac¬ 
rophobia  were  involved  in  the  study. 

Two  levels  of  exposure  to  stimuli  from  a  virtual 
environment  were  used.  First,  subjects  were 
exposed  to  a  pictorial  Stroop  task  using  pictures 
associated  with  heights  and  neutral  pictures, 
both  taken  from  virtual  environments.  For  the 
Pictorial  Stroop  task,  the  degree  of  activation  for 
fear  structures  was  operationalized  as  the  inter¬ 
ference  and  the  physiological  activation  during 
the  task.  Second,  subjects  were  exposed  to  a 
Virtual  Reality  Behavioral  Avoidance  Test  (VR- 
BAT)  (using  the  same  environment  the  picture 
was  taken  from  for  the  Stroop  task).  During  the 
test,  the  degree  of  activation  in  the  fear  struc¬ 
tures  was  operationalized  as  the  number  of 
steps  completed  (a  measure  of  avoidance),  the 
self-reported  fear  (Subjective  Units  of  Distress), 
the  level  of  confidence  and  the  physiological 
activation. 

For  control  purposes,  subjects  were  also  ex¬ 
posed  to  an  In  Vivo  Behavioral  Approach  Test 
(IV-BAT).  In  this  case,  the  degree  of  activation 
of  fear  structures  was  investigated  using  the 
same  self-report  measures  as  in  the  VR-BAT. 

Results: 

Compared  to  the  control  group,  the  acrophobics 
showed  increased  interference  and  physiologi¬ 
cal  reactivity  during  the  Stroop  task,  as  well  as 
increased  avoidance,  self  reported  fear  and 
physiological  arousal  during  the  virtual  and  in 
vivo  BAT.  The  degree  of  reactivity  was  similar  in 
the  virtual  environment  to  the  real  one. 


Conclusions: 

The  exposure  to  virtual  environments  produces 
a  level  of  activation  for  fear  structures  compara¬ 
ble  to  the  level  elicited  by  in  vivo  exposure. 


Based  on  these  results,  a  procedure  for  design¬ 
ing  virtual  environments  able  to  induce  an  opti¬ 
mal  level  of  activation  for  fear  structures  is  pre¬ 
sented.  Implications  for  optimization  of  treat¬ 
ment  using  virtual  environments,  in  terms  of  the 
duration  of  exposure  and  selection  of  the  most 
relevant  stimuli,  are  discussed. 

Contact:  Christian  Sirbu 
Phone:  (540)  231-8511 
Fax:  (540)  231-3652 
E-mail:  csirbu@vt.edu 
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Long-Term  Effectiveness  of  In  VR  Exposure  for 
Phobic  Children 

St-Jacques,  J.,  B.A.1,  Bouchard,  S.,  Ph.D.2,  & 
Renaud,  P.,  Ph.D.2 

1  University  of  Quebec  in  Montreal 

2  University  of  Quebec  in  Outaouais 

Research  status:  Complete 

For  approximately  10  years,  clinical  psychology 
has  seen  the  emergence  of  a  new  avenue  of 
treatment:  virtual  reality.  This  technology  has 
been  used,  among  other  things,  to  treat  anxiety 
disorders.  There  is  now  a  growing  body  of  sci¬ 
entific  studies  assessing  the  effectiveness  of 
virtual  exposure  (VR)  for  the  treatment  of  arach- 
nophobia  in  adults  (Carlin,  Hoffman,  &  Weg- 
horst,  1997).  This  alternative  treatment  offers 
multiple  advantages:  it  favors  confidentiality,  it  is 
safer  and  it  could  be  less  expensive.  Since  pre¬ 
liminary  data  of  this  VR  treatment  for  arachno- 
phobia  in  children  was  presented  last  year,  the 
focus  of  this  presentation  will  be  on  the  long 
lasting  effects  showed  six  months  after  the  end 
of  the  program. 

The  goal  of  this  study  is  to  assess  the  effective¬ 
ness  of  VR  exposure  for  arachnophobia  in  chil¬ 
dren.  This  study  relies  on  a  single  case  design 
with  multiple  baselines  across  subjects.  The 
sample  consists  of  seven  females  and  one 
male.  The  subjects,  aged  between  8  and  16 
years  old,  were  SCID-diagnosed  to  confirm  the 
presence  of  arachnophobia.  Participants  were 
randomly  assigned  to  one  of  three  base  line 
levels:  three,  four  or  five  weeks.  Participation  in 
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the  study  involves  six  sessions  of  approximately 
75  minutes,  of  which  five  sessions  are  weekly 
based.  The  first  session  is  to  confirm  that  all  of 
the  participants  meet  the  inclusion  and  exclu¬ 
sion  criteria  of  the  study.  The  second  session 
provides  participants  with  the  necessary  infor¬ 
mation  to  successfully  complete  the  program 
(informed  consent,  information  about  phobias 
and  avoidance,  etc.).  The  last  four  sessions 
consist  of  VR  exposure.  The  exposure  was  ad¬ 
ministered  using  a  standardized  treatment  pro¬ 
tocol.  Self-monitoring  of  fear  of  spiders  has 
been  conducted  weekly  before,  during  and  after 
the  treatment  with  the  children  and  their  par¬ 
ents.  At  pre-treatment,  post-treatment  and  six- 
month  follow-ups,  the  participants  also  filled  out 
a  series  of  questionnaires:  the  Immersion  Ten¬ 
dency  Questionnaire,  the  Depression  Self- 
Rating  Scale,  the  Fear  of  Spider  Questionnaire 
and  the  Fear  Survey  Schedule. 

Results  are  very  positive  and  suggest  that:  a) 
virtual  reality  exposure  might  be  helpful  with 
children,  b)  the  gains  are  maintained  over  time, 
c)  it  is  safe  to  conduct  virtual  reality  with  chil¬ 
dren  (an  issue  sometimes  raised  by  Ethics  Re¬ 
view  Board),  and  d)  larger  group-based  studies 
are  warranted. 

Contact:  Julie  St-Jacques 
CyberPsychology  Lab  of  University  in  Quebec 
in  Outaouais 
20  Pharand 

Gatineau  (Qc),  Canada  ,  J9A  1 K7 
E-mail:  iuliestiacaues@netscape.net 
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Evaluating  a  Video  Enhanced  Virtual  Reality 
Program  for  Teaching  Restaurant  Social  Skills 
to  Children  with  Autism 

While  Virtual  reality  has  been  used  for  various 
training  applications,  few  studies  have  meas¬ 
ured  its  effectiveness  in  teaching  social  interac¬ 
tions.  This  research  used  web  delivered  gaming 
technology  to  create  virtual  worlds  where  chil¬ 
dren  with  Autism  Spectrum  Disorder  (ASD)  in¬ 
teracted  with  avatars  to  practice  appropriate 
restaurant  social  skills.  Videos  of  similar  real 
world  situations  were  introduced  within  the  vir¬ 
tual  sequences  to  reinforce  the  lessons  and  aid 
in  generalization,  a  known  problem  for  individu¬ 


als  with  ASD.  Before  training,  two  unknown  res¬ 
taurant  social  skills  were  identified  for  each  of 
six  children  with  ASD,  aged  7  to  16.  After  virtual 
world  training,  all  six  children  correctly  per¬ 
formed  the  two  new  social  skills  while  in  the  vir¬ 
tual  restaurant,  and  four  children  exhibited  ap¬ 
propriate  social  interactions  in  post-training  real 
world  restaurant  settings. 


Presenter:  C.  Barr  Taylor,  M.D. 

The  Use  of  an  Internet  Based  Program  to  Pre¬ 
vent  Eating  Disorders 

Andrew  Winzelberg,  Ph.D.,  Kristine  Luce, 

Ph.D.,  Jennifer  Brown,  Ph.D.,  Smita  Das, 
Christine  Celio,  M.A.,  Parvati  Dev,  Ph.D. 

Stanford  Medical  Center,  Stanford,  CA  USA 

Research  Status:  Completed  clinical  trial  and 
work  in  progress. 

Background: 

Although  prevention  of  both  eating  disorders 
and  obesity  is  strongly  recommended,  combin¬ 
ing  eating  disorder  and  obesity  prevention  inter¬ 
ventions  for  defined  populations,  such  as  middle 
and  high  school  students,  is  complicated.  For 
instance,  population-based  interventions  must 
be  appropriate  for  all  students  in  the  classroom, 
including  those  who  do  not  have  risk  factors  for 
either  eating  disorders  or  obesity  and  the  inter¬ 
vention  should  not  stigmatize  any  students. 
This  paper  discusses  two  studies  aimed  at  de¬ 
veloping  universal  and  targeted  interventions 
that  aim  at  preventing  eating  disorders  and  obe¬ 
sity. 

Methods: 

Both  studies  involved  all  10th  grade  students 
enrolled  in  an  all-girls  public  school  in  Northern 
California.  In  both  studies,  all  students  com¬ 
pleted  Student  Bodies,  an  8-session  on-line 
psychoeducation  program,  linked  to  a  discus¬ 
sion  group.  The  program  provides  didactic  in¬ 
formation,  encourages  self-monitoring  and  jour¬ 
naling  and  is  linked  to  a  moderated  discussion 
group.  Students  are  assessed  pre-  and  post¬ 
treatment  using  standard  self-report  instruments 
to  assess  eating  disorder  attitudes  and  behav¬ 
ior.  In  the  first  study,  students  were  randomized 
by  class  to  the  intervention  (n=102)  or  control 
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(n=51);  parents  were  provided  an  on-line  dis¬ 
cussion  group  and  handout.  In  the  second 
study,  all  students  taking  health  education  were 
assessed  on-line,  provided  feedback  and  rec¬ 
ommendations  as  to  the  intervention  appropri¬ 
ate  to  their  risk  level. 

Results: 

In  the  first  study,  students  in  the  intervention 
reported  a  significant  reduction  in  restrained 
eating  (an  indication  of  eating  disorder  risk),  but 
the  effects  were  no  longer  significant  at  follow¬ 
up  and  a  significant  increase  in  knowledge. 
Parents  using  the  on-line  program  reported  a 
significant  increase  in  being  less  critical  to  oth¬ 
ers  and  in  their  own  outlook  on  life  compared  to 
the  control  group.  In  the  second  study,  1 74/1 88 
students  elected  to  participate  in  this  study  and 
were  assessed  online.  The  algorithm  identified 
1 1 1  no-risk  (NR),  36  eating  disorder  risk  (EDR), 
16  overweight  risk  (OR),  and  5  both  risks.  Fifty- 
six  percent  of  the  EDR  and  50%  of  the  OR 
groups  elected  to  receive  the  recommended 
targeted  curricula.  Significant  improvements  in 
weight  and  shape  concerns  were  observed  in  all 
groups;  effect  sizes  in  the  high-risk  participants 
were  in  the  moderate  range  (0.3-0. 7).  Of  the  1 1 
students  who  reported  self-induced  vomiting 
and/or  laxative  use  baseline,  seven  denied  self- 
induced  vomiting  or  laxative  use  and  three  par¬ 
ticipants  fell  below  the  threshold  level  at  follow¬ 
up.  One  participant  reported  continued  self- 
induced  vomiting,  but  reported  that  she  had  initi¬ 
ated  psychotherapy  because  of  her  participation 
in  the  program. 

Conclusions: 

An  Internet-delivered  program  can  be  used  to 
assess  risk  and  provide  simultaneous  universal 
and  targeted  interventions  in  classroom  set¬ 
tings.  Participation  in  the  intervention  is  associ¬ 
ated  with  significant  improvement  in  eating  dis¬ 
order  attitudes  and  behaviors. 


Novelty: 

These  and  earlier  studies  are  the  first  controlled 
studies  of  on-line  eating  disorder  prevention 
programs  and  the  first  to  address  issues  of  on¬ 
line  risk  assessment  and  allocation  to  interven¬ 
tion  based  on  risk.  They  demonstrate  the  feasi¬ 
bility  of  combined  universal  and  targeted  inter¬ 
ventions  for  defined  populations. 
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Assessing  Perceptions  and  Empathy  of  Victims 
in  Educators 

Research  Status: 

This  study  presents  preliminary  data  from  clini¬ 
cal  trials  currently  under  investigation  using  web 
based  and  a  supercomputing  Access  Grid  to 
assess  perceptions  of  victims  and  victim  empa¬ 
thy  of  pre-service  teachers.  The  Access  Grid  is 
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an  experimental  system  that  brings  people  to¬ 
gether  by  linking  high  speed  hardware,  cutting- 
edge  applications,  multimedia  displays,  and 
high  end  audio  and  video  technology  into  an 
efficient  persistent  computing  and  communica¬ 
tions  technology  (http://www.accessarid.ora). 

Multimedia  can  be  a  powerful  means  to  deliver 
representations  of  social  behaviors.  Little  re¬ 
search  has  examined  student  perceptions  of 
victims  and  victim  empathy  of  pre-service  teach¬ 
ers.  Much  work  has  been  done  on  victim  empa¬ 
thy  of  sex  offender  and  empathy  as  an  interper¬ 
sonal  phenomenon,  but  little  has  focused  on  the 
necessary  understanding  of  empathy  and  per¬ 
ceptions  of  student  victims  in  classroom  envi¬ 
ronments  (Hakansson,  2003;  Webster,  2002). 
This  study  investigates  (1)  perceptions  of  the 
victim;  (2)  to  reveal  the  level  of  empathy  that 
pre-services  teachers  have  for  the  victim;  (3)  to 
understand  the  strategies  of  action  suggested 
by  the  respondents;  and  (4)  the  type  of  behav¬ 
ioral  change  focused  on  by  the  respondent. 

Methods  and  Tools: 

This  exploration  reports  preliminary  results  from 
narratives  based  on  actual  school  experiences 
that  are  developed  into  animated  multimedia 
vignettes.  Seventy-eight  pre-service  teachers 
were  exposed  to  a  multimedia  animated  vi¬ 
gnette  narrative  depicting  a  discrimination  situa¬ 
tion  in  a  classroom  environment  (Fine  &  Weis, 
2003).  The  pre-service  teachers  responded  to 
the  narratives  by  assuming  the  role  of  one  of 
the  characters  (Fencott,  2001).  Creswell  (1998) 
writes  about  case  study  sampling  as  “bounded 
by  time  and  place”  (p.  37).  Utilizing  a  case  study 
approach  allows  for  a  better  understanding  of 
the  text  in  a  quantitative  and  qualitative  manner 
(Rosen,  Woelfel,  &  Barnett,  2002). 


Results: 

The  results  are  reported  by  the  following  cate¬ 
gories:  expression  of  concern,  empathy,  strat¬ 
egy,  focus  of  behavioral  change  and  manage¬ 
ment  focus.  The  respondents  expressed  con¬ 
cern  for:  Scott  29%;  Jamilah  4%;  Mr.  Young 
46%;  Ms.  Litts  1 1  %;  the  class  83%;  themselves 
6%.  Who  does  the  respondent  express  empathy 
with?  In  whose  position  is  the  respondent  able 
to  imagine  themself?  Scott  11%;  Jamilah  14%; 
Mr.  Young  6%;  Ms.  Litts  14%;  the  class  6% 
What  are  the  strategic  actions  suggested  by  the 


respondent?  How  do  they  suggest  they  would 
deal  with  the  immediate  situation?  (Immediate): 
Express  concern  63%;  Thank  Mr.  Young  9%; 
Assure  Mr.  Young  51%;  Apologize  34%;  take  a 
side  3%;  doubt  the  claim  3%;  invite  parental 
input  34%  (Longer  term):  Class  lesson  and/or 
discussion  89%;  talk  to  Scott  49%;  isolate  and/ 
or  discipline  Scott  14%;  force  Scott  to  apologize 
to  Jamilah  6%;  treat  as  an  isolated  incident  6%; 
make  a  conscious  effort  to  not  isolate  Scott, 
Jamilah,  or  the  incident  20%;  talk  to  Jamilah 
20%;  empower  Jamilah  14%;  talk  to  Scott’s  par¬ 
ents  31%;  hold  a  group  meeting  with  concerned 
parties  6%;  follow  up  14%  What  type  of  behav¬ 
ioral  change  does  the  respondent  focus  on? 
Proper  conduct  51%;  Correct  Information  29%; 
Proper  speech  20%;  Proper  thought  14%;  fos¬ 
tering  empathy  9%.  What  interpersonal  situation 
is  the  respondent  most  concerned  with  manag¬ 
ing?  With  whom  does  the  respondent  focus 
their  managerial  expertise?  Scott  46%;  Jamilah 
17%;  Mr.  Young  74%;  Ms.  Litts  3%;  the  class 
89%;  Scott’s  Parents  20%. 

Conclusions: 

The  findings  from  the  data  set  are  extremely 
important  in  understanding  our  approach  to¬ 
wards  teaching  and  learning.  It  also  helps  us  to 
understand  how  educators  think  about  problem 
solving  with  issues  that  are  related  to  under¬ 
standing  perceptions  of  victims  and  victim  em¬ 
pathy,  as  well  as  other  issues,  which  occur  in 
the  classroom  and  school  environments.  Fur¬ 
ther  analyses  can  reveal  more  on  the  nature  of 
empathy  towards  students  that  are  victims  in 
the  classroom  environment. 
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Design  Trials  of  the  Virtual  Buddy:  Progress 
Report 

Marc  M.  Sebrechts,  Ph.D.1,  Maya  Coleman, 
M.A.1,  Andreas  Finkelmeyer  M.S.1,  Ramesh- 
shandra  Ramloll,  Ph.D.2,  Linsey  Barker,  B.Sc.2, 
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2.  National  Rehabilitation  Hospital,  Washington,  DC, 
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3.  Anthrotronix,  Inc.,  College  Park,  MD,  USA. 
Research  Status:  In  Progress. 

Background: 

Face  processing  impairment  is  common  in  au¬ 
tistic  spectrum  disorders  (ASD)  (e.g.,  Klin  et  al., 
1999;  Trepagnier,  et  al.,  2002).  The  objective  of 
this  design  project  is  to  produce  an  environment 
for  delivery  of  an  early  intervention  to  train  so¬ 
cial  gaze  based  on  the  hypothesis  that  the  in¬ 
ability  to  process  nonverbal  communication  con¬ 
tributes  to  the  depredations  of  autism 
(Trepagnier,  1996). 

Method: 

An  arcade  'police  helicopter’  (the  pod)  has  been 
adapted.  The  child’s  gaze,  sensed  by  an  ISCAN 
tracker,  is  the  input.  Visual,  auditory  and  vesti¬ 
bular  stimuli  (rides)  are  provided  as  enticements 
and  rewards  for  gains  in  more  functional  social 
gaze,  in  a  voluntary  play  context.  Positive  con¬ 
sequences  will  ensue  when  the  child  gazes  at 
the  Virtual  Buddies’  faces,  and  when  that  gaze 
shows  an  interpretation  of  face-borne  informa¬ 


tion  (e.g.,  following  the  Buddy’s  gaze  direction). 
Issues  of  concern  in  the  design  of  this  environ¬ 
ment  include  appeal,  ease  of  entry  and  egress 
and  adequacy  of  positioning  for  successful 
tracking.  Nine  'neurotypical'  children  and  4  chil¬ 
dren  with  ASD  or  suspected  ASD,  mean  ages  4, 
each  accompanied  by  a  parent  (with  one  excep¬ 
tion)  have  participated.  Questionnaire  and  Likert 
scale  responses  were  obtained  from  the  12 
adults,  and  most  children  (who,  however, 
treated  the  scale  as  a  binary  choice).  Data  is 
being  compiled  and  analyzed.  A  semi- 
automated  calibration  (semi-autocal)  routine 
has  been  devised.  Once  a  good  eye  image  is 
visible,  the  investigator  triggers  semi-autocal: 
the  monitor  goes  blank  and  a  small  figure  ap¬ 
pears  in  the  next  location.  After  250  ms.  gaze 
coordinates  are  automatically  acquired  and  the 
video  display  resumes.  This  is  done  to  collect 
each  of  the  5  points  required,  in  order  for  Iscan 
calibration,  and  is  spread  out  over  time  to  re¬ 
duce  risk  of  boredom.  Appealing  video  has  con¬ 
tributed  to  capturing  and  holding  the  child’s  at¬ 
tention,  and  thus  acquiring  eye  tracking  data. 
The  next  pod  iteration  will  include  changes  in 
the  relative  angle  of  the  tracking  camera  and 
the  car  seat,  and  means  for  encouraging  stable 
head  position  (e.g.,  a  light  pressure  switch  em¬ 
bedded  in  the  seat  back,  so  that  the  video  is 
enabled  (or  brightens)  only  when  the  child’s 
back  is  in  contact  with  the  seat  back). 

Results: 

Data  is  continuing  to  be  acquired  and  reviewed. 
While  all  children  report  enjoying  the  ride,  they 
differed  in  respect  to  how  often  and  how  long 
they  wanted  to  experience  it.  Repetition  of  video 
material  quickly  lost  the  attention  of 
‘neurotypical’  children,  but  not  of  children  with 
ASD.  Tolerance  for  calibration  was  low,  requir¬ 
ing  careful  management. 

Conclusion: 

A  preliminary  inference  is  that  it  will  be  impor¬ 
tant  to  use  rewards,  including  preferred  video 
for  each  child  with  ASD,  not  just  to  reinforce 
target  behavior,  but  also  to  maintain  the  child’s 
participation.  Buddies  will  introduce,  praise,  en¬ 
thuse,  and  provide  the  gaze  training  opportuni¬ 
ties  that  video  and  other  preferred  experiences 
and  objects  will  need  to  reward  differentially. 

Novelty: 

In  relation  to  the  conceptual  presentation  of- 
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fered  last  year  we  will  present  data,  including 
some  video,  from  13  ‘models’  of  the  end  user, 
resulting  in  changes,  recommendations  for 
change,  and  the  validation  of  the  concept. 

Klin,  A.,  Sparrow,  S.  S.,  de  Bildt,  A.,  Cicchetti, 
D.  V.,  Cohen,  D.  J.,  &  Volkmar,  F.  R. 
(1999).  A  normed  study  of  face  recognition 
in  autism  and  related  disorders.  Journal  of 
Autism  and  Developmental  Disorders.  29 
(6):  499 -508. 

Trepagnier,  C.  (1996).  A  Possible  Origin  for  the 
Social  and  Communicative  Deficits  of  Au¬ 
tism.  Focus  on  Autism  and  Other  Develop¬ 
mental  Disabilities.  1 1  (3):  1 70-1 82. 

Trepagnier,  C.,  Sebrechts,  M.  M.,  &  Peterson. 
R.  (2002).  Atypical  Face  Gaze  in  Autism. 
CyberPsychology  &  Behavior,  5(3):  213- 
217. 

Contact:  Cheryl  Y.  Trepagnier,  Ph.D., 

The  Catholic  University  of  America, 

Washington,  DC,  USA 
Chervl.Trepaanier@medstar.net 
202  877  1487  Voice 
202  723  0628  Fax 


Presenter:  Veronique  Vaillancourt  Ph.D. 

Use  of  audio  VR  to  evaluate  functional  hearing 
abilities  in  the  workplace 

V.  Vaillancourt1,  C.  Laroche1,  S.  Soli2,  C. 
Giguere1 

1 .  Audiology  and  Speech-Language  Pathology  Pro¬ 
gram,  University  of  Ottawa  451  Smyth  Road,  Ot¬ 
tawa,  Ontario,  K1 H  8M5 

2.  House  Ear  Institute,  Los  Angeles,  CA 

Many  jobs  are  hearing-critical  and  have  several 
features  in  common:  they  are  often  performed  in 
noisy  environments  and  involve  a  number  of 
auditory  skills  and  abilities,  such  as  verbal  com¬ 
munication,  sound  localization,  and  sound  de¬ 
tection.  If  an  individual  lacks  these  skills  and 
abilities,  it  may  constitute  a  safety  risk  for  this 
individual,  as  well  as  for  fellow  workers  and  the 
general  public.  Predictions  of  performance  on 
these  auditory  skills  are  often  based  on  diag¬ 
nostic  measures  of  hearing,  such  as  pure-tone 
audiograms.  These  measures  are  unable  to 


provide  accurate  predictions  of  real  life  perform¬ 
ance  with  the  auditory  skills  necessary  to  per¬ 
form  hearing-critical  jobs.  In  our  research,  we 
have  used  more  direct  measures  of  functional 
speech  perception  in  noise  (Hearing  in  Noise 
Test:  HINT)  and  sound  localization  in  noise 
(Source  Azimuth  Identification  in  Noise  Test: 
SAINT)  for  screening  applicants  for  hearing- 
critical  jobs.  These  screening  tools  can  be  used 
under  headphones  or  in  a  sound  field  (using 
loudspeakers).  Since,  it  is  not  always  possible 
to  have  access  to  a  sound  proof  room  large 
enough  to  use  loudspeakers,  and  since  the 
sound  field  testing  is  sensitive  to  wall  reflec¬ 
tions,  the  use  of  headphones  is  a  preferred 
method.  In  order  to  reproduce  the  direction  of 
noise  and  sound  stimuli  (speech  or  environ¬ 
mental  sounds)  and  to  make  use  of  the  binaural 
hearing  system  under  headphones,  we  used 
audio  VR  technology.  With  this  more  accurate 
approach,  it  is  now  possible  to  test  functional 
hearing  abilities  in  clinical  settings  and  make 
judgments  on  the  ability  of  people  to  perform 
real  world  auditory  tasks.  Validation  data  (N  of 
subjects=  90)  for  a  Canadian  Coast  Guard  envi¬ 
ronment  will  be  presented. 

[Project  funded  by  Fisheries  and  Oceans  Can¬ 
ada,  Contract  F7053-000009] 


Presenter:  Mattias  Wallerg&rd,  MScEE  and  Li¬ 
centiate  in  Engineering 

Can  People  with  Brain  Injury  Transfer  Route 
Knowledge  from  a  Virtual  Environment  to  the 
Real  World? 

Roy  C.  Davies1,  Gerd  Johansson1,  Anita 
Linden2,  Kersin  Boschian2,  Bengt  Sonesson2 

1 .  Department  of  Design  Sciences,  Lund  Institute  of 
Technology,  Sweden 

2.  Department  of  Rehabilitation,  Lund  University  Hos¬ 
pital,  Sweden 

Research  status:  In  progress 

Virtual  Environments  (VE)  are  presumed  to 
have  the  potential  to  become  a  complement  to 
conventional  training  tools  in  brain  injury  reha¬ 
bilitation  (Davies,  Johansson,  Boschian,  Linden, 
&  Minor,  1999).  Possible  application  areas  in¬ 
clude  the  assessment  of  process  skills  and 
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training  in  daily  living  tasks  such  as  shopping, 
cooking,  and  using  a  telephone.  Studies  by 
Cromby,  Standen,  Newman,  Tasker  (1996),  and 
Mendozzi  et  al.  (2000)  suggest  that  it  is  possible 
for  people  with  cognitive  impairments  to  transfer 
skills  from  a  VE  to  the  real  world.  However, 
there  is  a  need  for  further  research  to  under¬ 
stand  how  and  to  what  extent  people  with  brain 
injury  can  use  skills  achieved  in  a  VE  in  a  real 
situation.  To  learn  more  about  this,  we  are  cur¬ 
rently  conducting  an  experiment  that  aims  to 
investigate  how  people  with  brain  injuries  can 
transfer  route  knowledge  from  a  spatial  naviga¬ 
tion  task  in  a  VE  to  a  real  environment. 

Six  able-bodied  people  and  six  people  with 
brain  injuries  participated  in  the  experiment. 
The  task  of  the  subjects  was  to  find  their  way  to 
a  certain  location  in  the  Department  of  Rehabili¬ 
tation  at  Lund  University  Hospital  after  having 
practiced  in  a  virtual  version  of  the  environment. 
The  VE  was  built  using  the  3D  game  editor 
WorldCraft,  and  the  experiment  was  done  with  a 
standard  PC  and  a  regular  monitor.  Video  re¬ 
cording  in  combination  with  a  retrospective  ver¬ 
bal  protocol  technique  was  used  to  get  informa¬ 
tion  on  the  subject’s  cognitive  process.  This 
means  that  the  subject  commented  upon  his 
actions,  while  watching  the  video  recording  from 
the  trial. 

So  far,  the  experiment  has  been  conducted  with 
six  able-bodied  subjects  and  three  people  with 
brain  injury.  All  able-bodied  subjects  managed 
to  find  their  way  without  getting  lost  or  hesitating 
on  the  way.  The  first  brain  injury  subject  had 
mild  memory  and  concentration  problems.  He 
managed  to  find  his  way  without  any  problems. 
The  second  brain  injury  subject  had  mild  mem¬ 
ory  and  attention  problems.  He  got  confused 
and  hesitated  at  two  occasions  but  managed  to 
find  his  way  to  the  location.  Finally,  the  third 
brain  injury  subject  had  severe  memory  prob¬ 
lems.  She  hesitated  at  two  occasions  but  man¬ 
aged  to  solve  the  navigation  task. 

The  most  interesting  result  so  far  is  that  the 
third  brain  injury  subject  managed  to  find  her 
way.  Her  occupational  therapist  was  utterly  con¬ 
vinced  that  she  would  fail  due  to  her  severe 
memory  deficit.  Our  hypothesis  up  until  now  has 
been  that  only  brain  injury  patients  with  mild  and 
moderate  cognitive  deficits  can  transfer  skills 
from  a  VE  to  the  real  world,  but  now  we  are 


starting  to  believe  that  even  patients  with  severe 
disabilities  might  benefit  from  VE  training. 

Cromby,  J.  J.,  Standen,  P.  J.,  Newman,  J.,  & 
Tasker,  H.  (1996).  Successful  transfer  to 
the  real  world  of  skills  practiced  in  a  virtual 
environment  by  students  with  severe  learn¬ 
ing  abilities.  Proceedings  of  the  Is1  Euro¬ 
pean  Conference  on  Disabilities,  Virtual 
Reality  and  Associated  Technology.  Maid¬ 
enhead,  UK.  103-107. 

Davies,  R.  C.,  Johansson,  G.,  Boschian,  K., 
Linden,  A,  &  Minor,  U.  (1999).  A  Practical 
Example  Using  Virtual  Reality  in  the  As¬ 
sessment  of  Brain  Injury.  The  International 
Journal  of  Virtual  Reality,  4(1 ):  3-1 0. 

Mendozzi,  L.,  Pugnetti,  L.,  Barbieri,  E.,  Attree, 
E.A.,  Rose,  F.D.,  Moro,  W.,  Loconte,  A., 
Corrales,  B.,  Maj,  L.,  Elliot-Square,  A.,  Mas- 
sara,  F.  And  Cutelli,  E.  (2000).  VIRT  -  fac¬ 
tory  trainer  project.  A  generic  productive 
process  to  train  persons  with  disabilities.  In 
P.  Sharkey,  A.  Cesarani,  L.  Pugnetti  &  A. 
Rizzo  (Eds.),  Proceedings  of  the  3?  interna¬ 
tional  conference  on  disability,  Virtual  Real¬ 
ity  and  associated  technologies.  University 
of  Reading,  Maidenhead,  UK.  115-122. 
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Can  MVA  victims  with  driving  phobia  be 
immersed  in  computer  simulated  driving 
environments? 

David  G.  Walshe1,  Elizabeth  J.  Lewis2,  Sun  I. 
Kim3,  Kathleen  O'Sullivan4 

1  Department  of  Psychiatry,  University  College  Cork, 
St  Stephens  Hospital,  Cork,  Ireland. 

2  St  Stephens  Hospital,  Cork,  Ireland. 

3  Dept  of  Biomedical  Engineering,  Hanyang  Univer¬ 
sity,  Seoul,  Korea. 

4  Department  of  Statistics,  University  College  Cork, 
Ireland 

Status:  Ongoing 
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In  an  earlier  study  we  showed  the  effectiveness 
of  computer-generated  environments  in  expo¬ 
sure  therapy  for  the  treatment  of  driving  phobia 
following  motor  vehicle  accidents  (MVA).  Seven 
treated  patients  showed  a  marked  reduction  in 
driving  phobia  severity  (p=0.008)  as  well  as  re¬ 
ductions  in  PTSD  severity  ratings  (p=0.008)  and 
depression  severity  (p=0.031)\  However,  50% 
of  the  cohort  of  patients  screened  in  this  study 
did  not  immerse  in  the  simulated  environments 
and  therefore  could  not  undertake  therapy.  This 
sets  limitations  on  the  use  of  virtual  reality  expo¬ 
sure  therapy  (VRET)  as  a  treatment  modality  for 
driving  phobia. 

Objective: 

To  investigate  if  an  acceptable  immersion  rate 
(>80%)  can  be  achieved  for  subjects  with  driv¬ 
ing  phobia  in  computer  generated  environments 
involving  modifications  in  the  VR  program  and 
augmented  reality  through:  projection  of  images 
onto  a  large  projector  screen,  visualizing  the 
screen  through  a  windscreen  and  increasing 
vibration  sense  through  stronger  subwoofers. 

Design: 

12  patients  referred  from  the  Emergency  De¬ 
partment  of  a  general  hospital  or  from  a  general 
practitioner  following  a  motor  vehicle  accident 
who  met  DSM-IV  criteria  for  Simple  Phobia/ 
Accident  Phobia  were  exposed  to  a  Virtual  Driv¬ 
ing  Environment  ( Hanyang  University)  and  com¬ 
puter  driving  games  ( London  Racer/Midtown 
Madness/Rally  Championship).  Patients  under¬ 
took  a  thirty  minute  trial  session  in  driving  envi¬ 
ronments  of  graded  difficulties  in  a  darkened 
room.  SUD  ratings  and  heart  rate  measure¬ 
ments  were  taken  at  five  minute  intervals. 
“Immersion,”  i.e.  a  sense  of  presence  with 
heightened  anxiety  in  the  driving  simulations, 
was  operationally  defined  as  in  our  earlier  study 
as  an  increase  in  SUD  ratings  of  >3  and/or  an 
increase  of  heart  rate  >15  BPM  in  computer 
simulation  driving. 

Results: 

Results  will  be  presented  at  the  Cybertherapy 
conference  together  with  video  presentations  of 
the  VR/GR  environments. 

Novelty: 

This  is  a  novel  study  in  the  area  of  VRET  for 
driving  phobia.  Findings  have  implications  for 
the  clinical  use  of  VRET  in  driving  phobia. 


Walshe,  D.G.,  Lewis,  E.J.,  Kim,  S.I.,  O’Sullivan, 
K.,  Wiederhold,  B.K.  (2003).  Exploring  the 
Use  of  Computer  Games  and  Virtual  Reality 
in  Exposure  Therapy  for  Fear  of  Driving 
Following  a  Motor  Vehicle  Accident.  Cy- 
berPsychology  &  Behavior:  The  Impact  of 
the  Internet,  Multimedia  and  Virtual  Reality 
on  Behavior  and  Society.  6(3):  329-334. 

Contact:  Dr.  David  Walshe 
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Glanmire  Cork  Rep.  of  Ireland 
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On-line  Game  Addiction  as  a  Luxury  syndrome: 
An  immersion  of  the  digital  world  as  a  consump¬ 
tion  of  digital  product 

Leo  Sang-Min  Whang,  SeJin  Heo,  MiYeon  Hur 

Research  status:  Complete 

An  excessive  participation  in  the  on-line  gaming 
world  is  defined  as  game  addiction.  However, 
this  immersion  in  the  on-line  game  world  char¬ 
acterizes  not  so  much  the  addiction  to  the  ‘on¬ 
line  game  world’  product,  as  an  immersion  in 
the  digital  world  itself.  This  phenomenon  seems 
to  be  not  only  the  excessive  use  of  the  on-line 
game  as  a  digital  product,  but  the  active  partici¬ 
pation  in  the  digital  world.  We  assume  the  ex¬ 
cessive  use  of  on-line  games  is  directly  related 
to  the  phenomena  of  ‘luxury  syndrome'.  This 
research  investigated  how  the  recognition  of  the 
commercial  value  of  on-line  game  worlds  and 
satisfying  the  needs  of  game  users  is  related  to 
the  degree  of  participation  in  the  on-line  game 
world. 

We  conducted  an  on-line  survey  on  one  of  the 
most  popular  on-line  games,  ‘Lineage’,  in  Asia. 
We  used  an  “on-line  game  immersion”  scale 
based  on  Young’s  Internet  Addiction  Scale,  and 
4,679  game  users.  Out  of  the  total  participants, 
the  levels  of  participation  in  the  on-line  game 
world  are  classified  as  ‘excessive  immersion’, 
‘potential  immersion’  and  ‘non-immersion’.  Out 
of  the  subject  pool,  7%  had  been  classified  into 
“excessive  immersion”,  while  12%  had  been 
diagnosed  as  ‘non-immersion’  and  the  rest  of 
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participants  were  sorted  as  'potential  immer¬ 
sion’.  The  degree  of  immersion  in  the  on-line 
game  world  showed  a  strong  relationship  be¬ 
tween  game  users’  recognition  of  the  on-line 
game  as  the  digital  world  and  their  behavior 
characteristics.  Between  the  two  extreme 
groups,  the  results  show  the  significant  differ¬ 
ence  in  terms  of  the  endowing  value  of  on-line 
game  worlds.  The  two  groups  are  markedly  dis¬ 
tinguished  regarding  the  psychological  desire 
for  a  human  relationship  fulfilled  by  the  experi¬ 
ences  in  the  on-line  game  world. 

This  research  presents  a  different  point  of  view, 
which  accounts  for  game  addiction  as  one  of 
the  various  lifestyles  designating  a  new  type  of 
life  in  digital  space,  not  the  degeneration  of  per¬ 
sonal  adaptive  function.  Consequently,  the  im¬ 
mersed  behavior,  like  on-line  game  addiction,  is 
regarded  as  the  behavior  characteristics  of 
‘luxury  syndrome’.  Further  study  is  needed  to 
investigate  interventions  for  game  addicts  in  the 
cyber  world.  We  suggest  further  research  on 
how  the  degree  of  immersion  in  the  digital  world 
influences  the  various  human  behaviors  and 
changes  in  thinking. 

Contact: 

Leo  Sang-Min  Whang,  Ph.D. 
swhang@vonsei.ac.kr 
Phone:82-2-2123-2439 
Fax:  82-2-365-4354 
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Clinical  Analysis  of  350  Patients  Completing  VR 
Therapy 

Brenda  K.  Wiederhold,  Ph.D.,  MBA,  BCIA1'2, 
Stephane  Bouchard,  Ph.D.3,  Genevieve 
Robillard,  M.Sc.3;  and  Mark  D.  Wiederhold, 

M.D.,  Ph.D.,  FACP1 

1.  The  Virtual  Reality  Medical  Center 

2.  Interactive  Media  Institute 

3.  University  of  Quebec  in  Outaouais 

In  August  1997,  the  Virtual  Reality  Medical  Cen¬ 
ter  (VRMC)  began  treating  patients  with  fear  of 
flying  using  a  combination  of  VR  and  physiologi¬ 
cal  monitoring  and  feedback;  completing  the 
first  controlled  study  in  1999  comparing  VR 
treatment  to  imaginal  exposure  (visualization) 


for  fear  of  flying.  Since  that  time,  we  have  ex¬ 
panded  our  clinical  services  to  include  VR  and 
physiology  to  treat  a  number  of  specific  pho¬ 
bias,  social  phobia,  panic  disorder  and  agora¬ 
phobia.  In  addition,  we  now  maintain  active 
research  programs  using  VR,  simulations,  ro¬ 
botics,  the  Internet  and  other  advanced  tech¬ 
nologies  in  many  diverse  areas  including:  eating 
disorders  and  obesity,  distraction  during  painful 
medical  and  dental  procedures,  teen  smoking 
prevention,  cue  exposure,  rehabilitation,  atten¬ 
tion-deficit  hyperactivity  disorder,  autism,  and 
quality  of  life  applications  for  those  with  long¬ 
term  illnesses.  We  also  utilize  simulation  and 
VR  for  training  in  such  wide-ranging  areas  as 
combat  casualty  care  and  teenage  driving  edu¬ 
cation. 

This  presentation  will  focus  on  our  initial  analy¬ 
sis  of  data  from  anxiety  disorder  patients  who 
have  completed  VR  therapy  at  the  VRMC. 

Contact: 

Brenda  K.  Wiederhold,  Ph.D.,  MBA,  BCIA 

bwiederhold@vrphobia.com 

1-866-822-VRMC 
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Training  Combat  Medics  Using  VR 
Mark  D.  Wiederhold,  M.D.,  Ph.D.,  FACP1; 
Brenda  K.  Wiederhold,  Ph.D.,  MBA,  BCIA1 

1 .  The  Virtual  Reality  Medical  Center 

Past  success  using  virtual  reality  to  support 
training  in  the  military  has  encouraged  the  con¬ 
tinued  exploration  of  new  areas  that  would 
benefit  from  virtual  training.  We  are  exploring 
how  virtual  reality  and  other  simulations  can  be 
applied  to  train  combat  medics  for  combat  casu¬ 
alty  care.  Significant  questions  on  training 
transfer  remain  to  be  answered,  and  a  variety  of 
training  methodologies  including  virtual  reality, 
patient  mannequins,  live  animals,  or  a  combina¬ 
tion  thereof  are  undergoing  evaluation  and  test¬ 
ing.  Issues  such  as  developing  metrics  that 
measure  successful  transfers  of  training  to  the 
real  world  are  underway  by  military,  academic, 
and  industrial  groups.  We  are  evaluating  train¬ 
ing  transfer  using  simulation  and  virtual  environ¬ 
ments  where  the  trainees’  physiological  signals, 
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focus  of  attention,  and  concentration  are  meas¬ 
ured.  Understanding  the  psychological  and 
physiological  state  of  the  trainee  during  training 
exercises  may  provide  a  useful  metric  for  gaug¬ 
ing  successful  transfer  of  information  to  be  used 
in  real  world  situations. 

Contact: 

Mark  D.  Wiederhold,  M.D.,  Ph.D.,  FACP 
mwiederhold@vrphobia.com 
1  -866-822-VRMC 
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Learning  to  Interact  with  People  with  Disabilities 
Using  Virtual  Environments 

Will  Lee,  M.S.,  Dr.  Doug  Bowman 
Department  of  Computer  Science,  Virginia  Tech 

Research  Status:  In  Progress 

Background/Problem: 

Virtual  environments  (VEs)  have  shown  poten¬ 
tial  for  teaching  social  skills  to  children  with  As¬ 
perger’s  Syndrome,  a  mild  form  of  autism 
(Cobb,  Beardon,  Eastgate,  Glover,  Kerr,  Neale, 
Parsons,  Benford,  Hopkins,  Mitchell,  Reynard, 
&  Wilson,  2002)  and  for  treating  phobias 
(Hodges,  Anderson,  Burdea,  Hoffman,  & 
Rothbaum,  2001).  However,  there  has  been 
little  research  on  using  VEs  to  teach  social  skills 
to  people  without  autism  or  phobias.  Our  goal 
was  to  design  and  implement  a  learning  envi¬ 
ronment  for  teaching  social  skills  to  average 
people  and  to  evaluate  the  usefulness  of  that 
application.  To  that  extent,  because  of  the  typi¬ 
cal  misconceptions  due  to  lack  of  previous  ex¬ 
posure  and  the  stereotypes  surrounding  disabili¬ 
ties,  we  chose  to  create  an  environment  teach¬ 
ing  participants  how  to  interact  with  disabled 
people. 

Method/Tools: 

We  developed  our  environment  using  the  Sim¬ 
ple  Virtual  Environment  Library  (SVE)  (Kessler, 
Bowman,  &  Hodges,  2000).  The  implemented 
environment  consisted  of  an  outdoor  park,  a 
virtual  person  who  is  blind,  and  a  guide  dog. 
Users  are  guided  by  verbal  and  physical  re¬ 
sponses  from  the  virtual  person  through  a  se¬ 
ries  of  four  ‘do’  and  ‘don’t’  guidelines.  To  evalu¬ 
ate  the  usefulness  of  the  application,  we  used  a 


between  subjects  single-factor  design  with 
twelve  participants  randomly  assigned  to  one  of 
two  display  conditions.  The  display  type  was 
either  a  desktop  or  a  head-mounted  display 
(HMD). 

Conclusion  /Results: 

The  results  of  a  free  recall  question  showed  that 
the  highest  percentage  (67%)  of  participants 
learned  not  to  play  with  a  guide  dog.  All  partici¬ 
pants  reported  that  they  were  more  likely  to  re¬ 
member  the  guidelines  after  interacting  with  the 
virtual  person  than  if  they  were  given  paper 
guidelines.  However,  when  asked  how  comfort¬ 
able  they  were  interacting  with  a  person  who 
was  blind,  there  was  no  significant  difference 
between  ratings  provided  before  and  after  the 
use  of  the  application.  More  was  learned  using 
the  desktop  than  the  HMD,  but  not  significantly 
more. 

Based  on  the  results,  we  believe  that  people  are 
more  likely  to  remember  the  lessons  after  hav¬ 
ing  used  the  application.  Although  the  novelty 
of  the  HMD  affected  the  perceived  impact  lev¬ 
els,  the  more  familiar  desktop  displays  resulted 
in  better  performance.  The  novelty  of  the  HMD 
may  have  distracted  the  users  from  the  task  of 
learning  social  skills.  Additional  research  is 
planned  to  determine  if  higher  levels  of  interac¬ 
tivity  result  in  better  learning  of  social  skills  and 
if,  based  on  the  idea  of  near  transfer,  users 
would  interact  appropriately  when  confronted 
with  a  real  person  that  is  blind. 

Novelty: 

The  potential  impact  of  this  in  the  future  is  that  if 
it  is  useful  for  populations  with  normal  mental 
capabilities,  it  could  be  extended  to  teach  social 
skills  to  people  not  able  to  physically  interact 
with  other  populations.  For  example,  the  treat¬ 
ment  of  a  sexual  abuser  could  involve  interac¬ 
tion  with  virtual  children. 
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